There are many children of all ages buried in the cemetery. Some have their names and ages written on the burial records and some sadly don't, they are recorded as "son or daughter of". The youngest baby so far that has these important details is Henry child of Sgt.James Welch from the 2nd Cheshire Regt. He died on 25th December 1883 aged 1 day. There is no headstone and his burial record is 714 Church of England.
Thank you to Sue for finding this.
There is a web site, The Army Children Archive which tells what it was like growing up as the child of a serving soldier in the British Army through the centuries.