Looking for NYC seafood restaurant for group with diet restrictions

All are allergic to tree nuts and one is also gluten-intolerant. Hoping for mid-price range and casual clothing OK.

Any suggestions?

I like the John Dory

http://www.thejohndory.com

Pearl Oyster Bar

http://www.pearloysterbar.com

And of course, the counter seats at the Oyster Bar in Grand Central.

http://www.oysterbarny.com

I highly recommend The Atlantic Grill. We've been to the one near Lincoln Center.

Fish on Bleecker.

Aquagrill in Soho!