Parashas Beshalach · Passuk 15:2
Chabad.org — English translation + Rashi
Torah Temimah points to Gittin 20a (verified).
Sefaria — Exodus 15:2
Sefaria — Gittin 20a
E-Daf — Gittin 20a
English: Rabbi Yose HaGelili expounded: How did they recite the song? An infant lying on his mother’s knees and a suckling nursing at his mother’s breasts — as soon as they saw the Shechinah the infant raised his neck and the suckling released the breast from his mouth and they said “This is my God,” as it is stated “From the mouth of infants and sucklings You have established strength.”
On the daf / in context: See the cited source for the full section.
Derash on the verse.
Even nursing infants and young children pointed and declared “This is my God” upon seeing the Shechinah at the sea.