It depends what aspect of colonization is important to your definition, I guess. Is it about imperialist expansion to non-contiguous territories, or is it more specifically about extracting resources from those territories for the exclusive benefit of the motherland?

At any rate, I would say that French Guiana either counts or doesn't count as a colony of France to the same extent that Hawaii counts or doesn't count as a colony of the United States.