I suspect (but am not positive) that this won't work the way you describe with SemanticImport. I think you might have better luck applying a function to the data after the import. Since you haven't provided any sample data to test with, I don't know exactly what to suggest, but it might be along the lines of
Quantity[#, "Days"] &/@yourdata
