In a small bowl, mix agar agar powder with about 1/4 cup of liquid from the milk or lychee syrup. Let it sit for 5 minutes.
In a saucepan over medium heat, combine heavy cream, milk, sugar, and the agar agar mixture. Stir constantly.
Bring the mixture to a boil and then simmer for 2 minutes, stirring continuously to fully dissolve the agar agar.
Remove from heat, then stir in lychee syrup.
Place lychee fruit into a container. Pour the cream mixture over the fruit. Let it cool to room temperature, then refrigerate for at least 2 hours or until fully set.