Computer programming is a process that leads from an original formulation of a computing problem to executable programs. Understanding the fundamentals of computer programming is considered a difficult task for students. This paper aims to identify the programming topics that are difficult for the students to learn and determine the factors that affect their learning the concepts. Results revealed that regardless of gender, students have difficulty in learning programming fundamental concepts. Furthermore, the grade in algebra determines the difficulty level of students in learning the concepts.