Jimmy was born on February 16, 1943. His mother died giving birth to him. He was the first child of James Irby. Jimmy was a member of St. Thomas Roman Catholic Church with his young children on the west side of Chicago. When the children transferred schools, he attended and regularly volunteered at St. Catherine - St. Lucy Roman Catholic Church in Oak Park, IL. Later in life Jimmy attended Rock of Ages Church in Maywood, IL.

He graduated from Farragut High School. He married Deborah Smith soon after she graduated from high school. They had three daughters Renata, Reishon, and Racquel.

Jimmy worked as a welder for Rheem Manufacturing, for several years, he worked at Hertz for years, and later worked at Lakeview Bus Company until he retired. He met his wife, Sabrina Hale.

He was preceded in death by both his mother and father. Jimmy was also preceded in death by Odessa Brown, his biological Aunt, who raised him with the help of his biological Maternal Grandmother until her death.

Jimmy leaves behind his loving wife of 11 years, Sabrina Hale; his daughters, Renata Irby (Manuel Canino), Reishon Irby-Owens, and Racquel Irby (Nathaniel Hawkins); his stepchildren, Cornealous Hale, Precious Roberson, and Armani Jones; grandchildren, Magon Martin, Stephen Canino, Naomi Canino, and Amber Owens; and his great grandchildren.