Since the recent expansion of higher education in prison (HEP) programs, correctional systems and universities have been working to optimize these programs to yield maximum impact. Collaborating with individuals with lived experience of incarceration and participation in higher education could provide valuable insights toward improving these programs. This paper reports on a community advisory board (CAB) of formerly incarcerated people, which set out to share ideas on improving higher education in prison based on their personal and shared experiences. These experiences and suggestions were grouped into themes outlined in this paper and accompanied by quotes from CAB members. Members described non-existent or negative relationships with schooling before incarceration. This lack of conversation, culture, or infrastructure for education continued into incarceration, though they recognized that school might have provided better opportunities for students and their families upon release. The board suggested that introducing a trusted, formerly incarcerated peer could help combat negative experiences with school, transition students into learning, and help them build the momentum to be self-sustaining in HEP. The novel insights generated by this CAB reflect the value of integrating lived experience in decision-making regarding HEP programs. [Note: The volume and issue (35, 4) shown in the citation on the PDF are incorrect. The correct volume and issue are 36, 1.]