There are a few book clubs that specifically target atheists and require in-person gatherings…
But if you want to discuss interesting books with a group of non-religious people, you have a number of options that don’t require much physical travel:
Join one of them. Join all of them.
(When you join, don’t hesitate to recommend this book!)