I'm in a pretty similar situation as you. My father has had a small excavation business for 30 years, I'm 23 so I grew up around skidsteers and mini excavators. At 14 got into electrical shop in a technical high school, at 16 won one of two spots in IBEW Local 103, and at 18 got my Class A CDL and 2A/1C hydraulics license and started in the IBEW apprenticeship.
After a year went out to work with a company who does a lot of undergrounnd, but more importantly solar farms. They held onto me for the sole reason that I was a good Lull operator and I could drive their CDL bucket trucks, crane truck, and wire pulling truck/trailer. So they sent me for my 1B hydraulics license and OSHA certified rigger/signal person card.
I've made a great living for the last 6 years running equipment and trucks as a union electrician. Of course I also have the benefit of doing dirt work and snow removal on the side to "get my fix" so to speak, but the real money is in the union. The way I look at it, right now you should have plenty of job security, as I do, where changing to IUOE you become just another operator.
Around here, IUOE does all our digging because IBEW companies don't carry the insurance, and don't want the liability of digging in the crowded streets around here, but we do all of our own material handling (lulls) and cranes (the one I ran was a 17 ton "boom truck"), after that IUOE takes over.
Of course it's your life, your career, and your decision, but if you like what you do, I say try to find a similar gig where you're moving to. They are out there. Myself, I like being able to be running 4" rigid conduit Monday, doing fire alarm Tuesday, doing plugs and switches Wednesday, solar panels Thursday, running a Lull or crane on Friday. I get gratification from being a multi dimensional employee rather than only being able to do one thing.