Meanwhile, toast allspice and 2 cinnamon sticks in a medium saucepan over medium heat, stirring often, until fragrant, about 3 minutes. Add cashews, milk, sugar, and kosher salt and reduce heat to low. Cook, stirring occasionally, until cashews soften and flavors infuse (do not let milk boil), 20–25 minutes. Let cool slightly.