The song "Penitentiary" by Houndmouth tells the story of a person who resorts to a life of crime after not being able to find a job. The protagonist hides a stash of something in San Francisco and learns how to rob as a means of survival. They then take a train to Houston but are unable to escape the authorities. The lyrics mention the protagonist playing "stud" (a type of poker game) in the evening and being in solitary confinement at night. They speak of interacting with individuals named Leon and Capone, who seem to be fellow inmates. The song also mentions a chess metaphor, where the protagonist is playing a game with a man from Arkansas, and their position in the game is about to collapse. The chorus "Come on down to the Penitentiary, oh mommy the law came crashing down on me" suggests that the protagonist ends up in prison as a result of their criminal activities. Towards the end of the song, the protagonist is depicted calling from a payphone near Lawrence Bend, possibly after being released from prison. They mention receiving a pardon and expressing an intention to start their life of crime again. Overall, "Penitentiary" tells a story of desperation, crime, imprisonment, and the cyclical nature of a life caught in a perpetual cycle of wrongdoing.