Drywall to be consistent. Boxing it in by making a wood frame. 2x2s would work.

Quick and dirty would be to take a piece of panelling and nailing it down then coating with some joint compound and taping the joints.

Fill it or box it in. Looks as if the basement is a livable area why not keep it cleaned up.