Straight legged pant with side panel