Might be worth getting a multimeter and checking the battery voltage. Can pick one up for a few bucks if you don't already have one.
The way you're describing it, it sounds as if there's not enough voltage/battery is dieing, so yeah, it's probably just a new battery.
Bookmarks