1. Beat together sweetened condensed milk and cocoa in medium bowl. Add evaporated milk and vanilla; beat until smooth.
2. Pour mixture into 8 small paper cups or 8 popsicle molds. Freeze about 2 hours or until almost firm. Insert wooden popsicle stick into center of each cup; freeze until solid.