You're on the right track. 研究会 is commonly used as the name of a culture (文化系) club at high school, so usually "Comic Book Club" should be enough. 漫画研究会 is so common in Japan that it's often abbreviated to 漫研(まんけん).
But there's a catch; depending on the school, the name 研究会 (or 同好会, 愛好会, etc) may be used to refer to a smaller group which is not large enough to qualify as a "proper 部" with a financial support from the school. For example, please read chiebukuro questions like this and this. If this distinction is important in your story, you may have to find a translation other than "club". Perhaps "circle" is a good candidate (see this for example).
僕の学校では
研究会⇒同好会⇒部活動 と昇格する形です
研究会は出来たばかりの団体です。
実際の違いは部費が出るかどうかです。
(typo corrected by me)