Miami rallied for three runs in the ninth but came up just short, falling to 3-9 on the season.
"It's tough right now," Latos said. "The best part about it is it's April. We're not going to win anything in April or May. The playoffs don't start in May. We all have to come together, which we are. We play as 25. We've got a great ballclub. It's just a matter of putting things together."
Miami is 2-4 on the road trip, having dropped three straight at New York.
On Saturday, Dee Gordon had a five-hit game, and he continues to be the most consistent player in the early going.
"Dee is swinging a hot bat," Latos said. "I'm starting to throw the ball like I used to. We've got a couple of guys who are just scuffling, including myself. If you look at my first two outings, they weren't the greatest. It's just putting it all together.
"It's early. We take the bad when the bad comes. I'll tell you what, when we put it all together, pitching, defense and hitting, there's going to be hell to pay. We're a great ballclub. I believe that. It [stinks] real bad right now."
Joe Frisaro is a reporter for MLB.com. He writes a blog, called The Fish Pond. Follow him on Twitter @JoeFrisaro. This story was not subject to the approval of Major League Baseball or its clubs.