Automated Classroom Lecture Note Generation Using Natural Language Processing and Image Processing Techniques

Teachers use different teaching methods to deliver the course content to the learners. Smart learning environments helps to reform of the ways of teaching and learning through advancing current methods. These environments help learners to enhance their knowledge and skills by engaging in different learning activities. These different methods can be use of power point, white board drawings, and online learning platforms, audio and video inputs. Teacher's main aim is to maximize the learner engagement in developing knowledge and skills. The teachers' expectation is that the learner's to gather knowledge though the variety of lesson materials. This paper describes a research approach on how the learning materials, smart white board input and the lectures' voice input can be combined in generation of compiled lecture note. In developing the solution it has used the voice input, white board diagrams and other earning materials used in the classroom, materials given in the Learning Management System and any internet materials. The study has adapted Natural Language Processing and Image Processing techniques. Main components of the research were text segmentation, text summarization, topic modeling, and diagram recognition. Outcome of the research can be used by the teachers and learners in day today work.