I highly recommend checking out the Make: Electronics series. You can also buy kits for each book on Amazon if you don't feel like going out and finding all the parts yourself at RadioShack.
This is what I've started with, too. Make: Electronics, Make: More Electronics, and the 3-volume Encyclopedia of electronic components by Charles Platt are really great.
The 8-Bit Computer video series by Ben Eater (reshared on HN recently, https://eater.net/8bit/) was the first thing I saw which ignited a passion for understanding the hardware underpinnings of computing.
ElectroBoom, GreatScott, EEVBlog, Julian Ilett, and Adafruit YouTube channels are really great, too.
This is what I'm working through and I like it. I've read a ton but nothing clicked until I started actually "doing". And the components are all available in kits. (Make: Electronics Components Pack 1, etc). You can get the stuff cheaper, but this puts it all together in one place for you.
