Bring the brown sugar and corn syrup to a boil. Stir constantly and add the butter pieces and sweetened condensed milk. Continue stirring constantly over medium heat. Cook to a semi-firm ball. Cooking time will vary depending on how high you have the heat. If I drop some caramel in a cup of cold water and if it can be made into a semi-firm ball...it's ready.