You could pick up just the basics at the grocery store (mascara, eyeliner, eyeshadow, foundation, powder, lipstick, makeup removal pads) and practice, practice, practice. You don't need top of the line cosmetics while you are learning and experimenting so you can buy the less expensive stuff for now and step up later.
I've noticed that a lot of makeup videos suggest using a whole lot of different products at the same time and that can be overwhelming when you are just trying to learn the basics. Once you have a good grasp on the basics then you can get fancy. And often less is more with makeup.
I look at some early pics I took of me and think "clown makeup" but those early efforts were important; they taught me a lot about what to do and what not to do, and a lot about what I need and don't need.