You're on the right track. 研究会 is commonly used as the name of a culture (文化系) club at high school, so "Comic Book Club" should be enough. Actually 漫画研究会 is so common in Japan that it's often abbreviated to 漫研(まんけん).

This largely depends on the school, but 研究会 (or 愛好会, 同好会, etc) may refer to a smaller club which is not large enough to qualify as a "proper 部活動" that has a financial support from the school. For example, please read [this chiebukuro question][1].

> 僕の学校では  
**研究会**⇒同好会⇒部活動 と昇格する形です  
研究会は出来たばかりの団体です。  
> 実際の違いは部費が出るかどうかです。  
<sub>(typo corrected by me)</sub>

  [1]: https://detail.chiebukuro.yahoo.co.jp/qa/question_detail/q1278330402