Hailing from Chico, CA, the four original members of Number One Gun began crafting energetic, Christian-minded rock in 2001. Frontman Jeff Schneeweis, bassist Trevor Sellers, guitarist Ben Tietz, and drummer Jordan Mallory released their first EP, Forever, in 2002. The group was subsequently offered a record deal with Salvage after a chance meeting with Dave Tosti, an A&R rep for the small label as well as a group member of PAX217 (a band Number One Gun had opened for). They began recording with Bob Burch in January 2003, with Floodgate Records climbing aboard to help with the album's marketing and distribution. The resulting album, Celebrate Mistakes, was released at the end of the summer.