Place tea bags, cinnamon sticks, and cloves in a large measuring cup or bowl. Add hot water; allow to steep 15 to 20 minutes. Carefully strain tea into a large pitcher. Discard cinnamon sticks and cloves.
Stir in sugar and coconut milk until dissolved. Cool completely. Refrigerate until ready to serve. Serve over ice.