Yes, but usually Amazon charges the sales tax.
If sales tax was charged for the same state that you are filing, then you needn't also pay use tax.
If you purchased something tax-free and brought it into the state you are filing, then yes, you pay use tax on that item.