Possibly, Alyosha was taller then Anastasia, BUT can't grow 5 inches, it depends on family genes too. Alexei- 5'3 instead of 5'1. He was possibly called the "Small one" because he was very thin. While Anastasia was a tiny bit pump.
Genes (this is my point of view, feel free for correction):
Nicky -short, small farmed in way like his mother, but at the same time masculine looking and had his father’s corn flower blue eyes and dark blonde hair. Nicky’s eye shape like his father’s. He wasn’t bald at the time of his death, but had gray hair. Slim. In the middle of Fair and dark. (As an infant –curly hair, as a child and as an adult- straight)
Alicky- Tall, and regal looking, (slim in youth, after Alexei was born- a bit pump) possibly from her father, deep gray eyes and golden red hair- copper or light brown to others, from both parents (Alice had light brown hair with tent of red, Louis had dirty blonde), Alice and Queen Victoria’s hock nose. Louis’ eye shape. Fair. (Straight hair as an infant and to adulthood).
Olga- Arrange height and size, dirty blonde hair, corn flower blue eyes, her father’s nose and eyes. Fair. (Had some curls as an infant and child, wavy as teen to early adulthood)
Tatiana- Tall, Slim, Alicky’s eyes and coloring, auburn hair, gray eyes. Fragile, regal looking. A mix between Alix and Nicky’s nose. (Straight hair as infant, late childhood to early adulthood, however in early childhood 1899-1902, wavy, curl hair)
Maria- Arrange height, pump, dark golden hair, looks like Olga, but has her father‘s complexion. Blue-gray eyes. (Infant to around eight years old- curly hair, wavy from that point on)
Anastasia- Short, Pump, dark blonde hair with red copper tent. Corn flower blue eyes. Alix’s hock nose. Lighter then Maria, but darker then Olga in complexion. (Infant to three- curly hair, from 1904- straight hair, Not really wavy)
Alexei (didn’t life long enough to know to total growth) - as small child to 10- golden hair, pump, tall, complexion like Maria. Eyes like his mother, eye shape like his father. Older then 11 – slim, golden blonde hair with a copper tent, then seem darker like Tatiana. From infancy – curly hair to three his hair became straight (it was cut short, so we don’t know for complete share)
So, do to genes, what do really think what was Alyosha's height, Now 5'3