My favorite park is Fort Tryon at the tip on Manhattan, it’s beautiful but sort of off the tourist radar. You can also check out the Cloisters Museum while you’re there as well.
If you come in warm weather, I also love a lot of the tiny community gardens and pocket parks in the East Village & Alphabet City.