Without a bit of calculus, you cannot simply deduce from the inverse square law that orbits will be elliptical. You have to work through the equation of motion of the planet to determine its path, and then see that the equation you get for its path is 'simply' that of an ellipse. Have a look at an undergraduate textbook in physics to see how this derivation works out. It is pretty neat!