Does it have a plate on it any where stating the current draw in amps or the Watts its designed to operate at?
If not, I'd google similar size winches and see what they are rated for and see what cable size is recommended.
To give you an idea, you looking at cable similar to that used for...