Short answer, yes. It's NYC, you can get just about anywhere in the metro via public transport. There is a train from EWR to the city, and trains from there to La Guardia.
If your group is large enough, get a car service. We took one from EWR into the city and back for the UConn trip. With five people it was worth the $ and quicker than the train.