Linds is right, they tend to come with natural substrates.
If it really bothers you, get a can of Black Knight and give your terrarium a few quick squirts. That stuff can kill almost any type of insect, and is totally harmless to both you and your reptile. My friend regularly sprays the stuff all over his basement apartment to get rid of bugs.
Hope this helps.