Frederick learned the alphabet on his own and made friends with poor white children he met on errands and used them as teachers. He paid for his reading lessons with pieces of bread. At home Frederick read parts of books and newspapers when he could, but he had to constantly be on guard against his mistress. Sophia Auld screamed whenever she caught Frederick reading. Sophia's attitude toward Frederick had changed, she no longer regarded him as any other child, but as a piece of property. Frederick gradually learned to read and write. With a little money he had earned doing errands, he bought a copy of The Columbian Orator. From reading this, Frederick became convinced of the injustice of slavery and the right of all people to be free. Frederick began to detest slavery.
During this time, Aaron Anthony died, and his property went to his two sons and his daughter, Lucretia Auld. Frederick remained a part of the Anthony estate and was sent back to the Lloyd plantation to be a part of the division of property. Frederick was chosen by Thomas and Lucretia Auld and was sent back to Hugh and Sophia Auld in Baltimore. Within a year of Frederick's return to Baltimore, Lucretia Auld died. The two Auld brothers then got into a dispute, and Thomas wrote to Hugh and demanded the return of his late wife's property, which included Frederick. In March of 1833, the 15-year-old Frederick was sent to live at Thomas Auld's new farm near the town of Saint Michaels. Frederick had to go back to physical labor out in the farms. Thomas never feed his slaves enough food so many starved and had to result to stealing in order to eat. Frederick received many beatings while there and witness worse giving to fellow slaves. .
In January 1834, Frederick was sent to work for Edward Covey, who was known for being a "slave breaker". Covey gave plenty for the slaves to eat but not enough time to it so many went hungry. Covey worked the slaves all day and had no sympathy for them.
