Just my humble opinion, but:

For one of the best, semi-reasonably priced small bore target rifle, I suggest a Savage Anshutz bolt action, bull barrel, single shot, with Lyman sights. I have had one since 1960 and have pounded 6 penny nails with it at 50 ft. (I had very good eyes back then).
A descent price will about $750.00. Once you own one, you will love it.

As for a pistol, I would choose an S&W model 41 in .22 Cl.

Bruce