Open Your Heart was recorded in the summer of 2011 at Python Patrol studio. Open Your Heart was almost finished when Leave Home, The Men's second album, was released. The album cover came from a stag magazine, with the vulgar elements in the background blacked-out. The album was first announced on December 14, 2011. The first song released from the album, "Open Your Heart," premiered online on January 24, 2012. A second song from Open Your Heart, "Ex-Dreams," was released February 17, 2012.
Open Your Heart has received generally positive reviews. On Metacritic, the album has a score of 83 out of 100, indicating "universal acclaim." Jason Heller of The A.V. Club wrote that "With Open Your Heart, The Men have taken that breath. And it’s only made their hearts beat faster." Pitchforks Ian Cohen gave the album a "Best New Music" designation, writing "Open Your Heart is smartly sequenced to metabolize genre and morph like a masterful DJ mix, subtly rationing out its true peaks even while seemingly going full-throttle throughout." Cohen concluded: "f you bought their t-shirt, came to their show, raved about Leave Home on your Tumblr, or seek to carry on tradition by starting your own band, Open Your Heart is the Men thanking you in the best way possible." In another positive review, Rob Harvilla of Spin wrote "Open Your Heart improves the band's focus even as it widens its range, ditching the harrowing, hacking-death-cough stuff and reaching for something more… let's say 'pastoral.'" Emma Sundstrom of PopMatters was more mixed towards the album, calling the track "Candy" "annoying" and the album's longer songs "hit and miss." Sundstrom concluded: "At the end of the day, the Men aren’t quite all they’re cracked up to be, but even a bitter cynic like me has to admit, this album is worth a listen. It’s too watered down to stand the test of time, but right now, it hits the spot." Pitchfork ranked Open Your Heart at number 30 on its list of the best album of 2012, with Ian Cohen writing: "It’s risky to use their studio albums to say anything definitive about the Men at this point. So let’s just forget about narratives and evolution and appreciate Open Your Heart as a record that makes them sound capable of doing whatever the hell they want. It cycles through barnstorming classic rawk, searing punk, beer-chugging country, and muscular krautrock. If you basically like any kind of music made with guitars, there’s something for you here." The same website ranked the title track at number 40 on its list of the top 100 tracks of 2012. The album was listed at number 17 on Stereogum's list of top 50 albums of 2012.