I have downloaded the latest version of Parity. Installed it. It started by default and asked to create an account. I created the same and got some ethers from the parity faucet site by requesting manually. Although etherscan site showed that I have 5 ethers but in my parity UI interface it showed 0. Then realized that it default started in Homestead mode. So I closed parity process manually and then started with parity ui --chain=kovan
parameters.
This time it did open in kovan mode but again it asked to create a new account and there was no way to skip it. I killed parity process. Copied the json key file from C:\Users\...\AppData\Roaming\Parity\Ethereum\keys\ethereum
to C:\Users\...\AppData\Roaming\Parity\Ethereum\keys\kovan
folder again restarted parity with same parameters.
But unfortunately it didn't help and still asked for creating a new account. So need a way to start parity by providing my account details so that it loads the same and doesn't ask to create a new one.