My husband and I are currently talking about this same thing. It started when I was looking for support groups for my transition nearby and couldn't find anything locally.
We live where we're just outside a large metropolitan area where there are a lot of resources, but for those of us living just outside that area - they're fairly inconvenient for those with transportation means, and more or less completely out of reach of anyone without. It's kind of a deadzone for community groups despite being a rapidly growing area itself, where people just tend to look towards the metro area rather than locally.
We've started doing some heavy research for any existing groups we've just not managed to turn up yet and are looking at setting up a community group, with hopes of growing to a point that we might be able to get some grant help in setting up an actual physical center. My husband handles a lot of work-place subjects and currently works with his company (a fairly large one) on addressing LGBTQ+ issues within the company and reaching out to the community, and is interested in offering his experiences and knowledge to people on that aspect of life as well as learning from the community what he can take back into his corporate life to help build a better workplace. I am very interested in working with youth, families, and those with disabilities - areas that are more my wheel house - on information, community, and accessibility.
It is a daunting task, but I'm hopeful that we can create something with the local community. It's actually the main reason I stopped lurking around this forum and actually signed up.

To try and network with individuals who have done or might be doing the same sort of thing to share ideas.