Somebody at BIAB has gone to a lot of trouble grouping the tracks into styles, so that is what I usually start with rather than combing through the thousands of tracks individually. So to begin with you have a group of instruments that match the kind of sound you have in mind, playing in a suitable style. You can tell it to add fills or you can add others from a non BIAB source like EZ Drummer in your DAW of course.
Someone else can probably help you more because my songs are all melody and lyric. They don't rely very heavily on drum fills and the like.
I think your reasons for considering BIAB are spot on.