In the first year of this body, there was a 350 engine option, so anything is possible. If you're looking for a performance upgrade, why not stick with what came with the car as the V8 option and build from there. Because most all of the V8's that came in this body style were 5.0 Liter (307 cu. in.) Oldsmobiles, why don't you take a look at a 403 (6.6 liter) Olds. They're the limit of how far that particular "small" block was built. Oil pans, motor mounts, etc are all the same. The 455 Olds is a little different. There are LOTS of aftermarket options available for that 6.6 liter motor. (FYI, the 6.6 liter Olds engine was what Pontiac used in their Firebird Trans Ams that had the Automatic transmission - remember the Smokey and the Bandit movies?)
Edlebrock makes aluminum intakes, and heads, and there are builders like Mondellos
http://www.mondellotwister.com/ who specialize in Olds performance. The weak link you'll need to deal with, with more power in this chassis, will be the driveline. I have no idea what can be done to a 325-4L transmission to strengthen it. The transmission uses the BOP bellhousing so any of the motor could work. The Olds engine has a rear mounted distributor unlike the Buick; installing an Olds motor would not require butchering your wiring harness. This swap has been done before. I think if you were to do some internet searches, you might find some info on them. Or, perhaps Jayson (Mr. 6th generation Riviera) Pruitt might know something more about this.
Check out this Oldsmobile FAQ website for other Oldsmobile info and perhaps some other options - like their 180 hp 5.0 liter motor.
http://www.442.com/oldsfaq/oldsfaq.htm
Ed