Can I keep my step children while my husband is on harvest?

My husband has residential custody of his three children and is thinking of taking a job with a harvest crew to earn some good money to help us get out of debt. This could possibly make him gone for a few weeks at a time with only short times home on some weekends. If I continue to current parenting plan, visitation schedule and such can the biological mom take us to court because dad isn't there as much?