Picasa Web Albums lets you edit the captions of your uploaded photos. You can do that one photo at a time, or using a single page. Picasa Web Albums also dropped the "test" from its logo, but it wasn't yet replaced with beta.
And if you weren't yet aware of that, you can embed photos into your site by clicking on "Embed in blog/MySpace" link. Unfortunately, you'll embed only a thumbnail, but if you're smart enough you'll manage to customize the thumbnail. (Hint: replace s288 from the image URL with s576 or s followed by some multiple of 144.)