The inactivity fee is tied into the house cleaning of the blockchain. The old stale data has to be moved to front of blockchain to enable pruning. So at some point your genesis block entries will need to be moved to front of chain and if you haven't you will be charged the inactivity fee.