Matching tops and bottoms of the same fabric is fine.
In fact, that is the standard for fine men's suits. The fabric of the tops and bottoms match.
I'm so small I never could do that as a guy. Always had a mismatch.
But, a mismatch usually doesn't work.
There are exceptions to every rule but the mind doesn't like to see small differences.
Which is why wall paper comes with lot codes so you can make sure every roll comes from the same press run. A small color shift is bad.
Sometimes I see on Revolve that certain items are not available as a set, though you can buy matching tops and bottoms of the same fabric.
They don't want the hassle of customers arguing about exact color matching.