Just as the Internal Revenue Service is getting into its perennial tax-season tough talk, Justice Department officials weighed in Tuesday with a vow to ramp up efforts against "tax defiers."

A tax defier is not a wealthy individual who buys a sophisticated tax shelter in a fraudulent effort to shield legitimate income from taxes. Nor is a defier a taxpayer who has...