Is it possible to keep auto-play on Wi-Fi but off on mobile data?

Yes, Facebook gives you the choice. You can select “Play on Wi-Fi only” if you want to save your mobile data but still allow videos to play automatically at home when you are connected to Wi-Fi.