Creation of a Diagnostic Tool/Online Resource for Mathematics Support

Posted on

Each year UWE Bristol funds Pedagogic Projects across the University on a variety of themes. In this blog, Rhys Gwynllyw, Emily Walsh, Oliver Haslam, Karen Henderson, Patrick O’Flynn, Danny Elvidge, Kevin Golden discusses their 2018/19 project to develop an online maths tool.

Mathematics, Maths, Computer, Laptop, Business, Graphs
Image of a laptop with maths symbols

Why?

Data analysis from the Mathematics cluster’s espressoMaths service over many years has indicated a strong demand for additional Mathematics support from students across a broad spectrum of programmes. This demand spans all of UWE’s four faculties. This has been particularly the case for students in their first year at UWE on programmes that contains Mathematics but do not have Mathematics as a pre-requisite at A-level. In some cases students can be quite surprised as to the amount of Mathematics they will use; this can be quite challenging for students who have not done any Mathematics since GCSE level.

In discussion with programme leaders across broad range of programmes at UWE, we identified a need for an automated Mathematics support resource targeted at transitioning students with the two primary aims of (a) providing targeted support with dynamic feedback and (b) to aim to reduce the students’ anxiety levels at what is a particularly stressful time. We decided that this resource would be made available to students prior to the start of their studies, thus extending our Mathematics support.

How?

The project team had a large amount of experience in designing and building electronic learning resources. Our expertise in the Dewis [1] e-assessment system, together with extensive use of the Xerte [2] interactive learning resource resulted in the decision to produce a one-stop diagnostic tool that would use intelligent branching to dynamically direct students to targeted learning resources within the system. The presentation of this learning resource would be bespoke to individual programmes although, where possible and appropriate, learning units could be shared across programmes.

As part of the initial pedagogic project, two pilot programmes engaged with the project namely, Foundation Architecture and Health Science Apprenticeships. For these two programmes, a list of key mathematical topics were identified. This information was obtained by data mining the espressoMaths logs and also through discussions with the programme leaders. Each of these topics were further split into sub-topics to enable the learning resource to partition its support to the student. For each of these sub-topics the following were created:

  • a Dewis e-assessment, with intelligent marking and bespoke feedback;
  • a Xerte learning resource (XLR) supplying a coherent learning mechanism for the sub-topic. This XLR would typically contain instructional videos, additional e-assessments (Dewis or otherwise) and links to additional material. During the viewing of a video, Xerte can present key points at different stages in the viewing to add emphasis. Break points can also be used to present a mini e-test at appropriate stages.

The created learning resource facilitated Dewis and Xerte to communicate with each other and be able to monitor the student’s engagement with both resources. The Xerte resource made use of pre-existing maths instruction videos sourced from YouTube and this enabled the project to cover a greater number of topics than might otherwise have been possible as we did not need to spend time producing instructional videos ourselves.  The project augmented the videos in Xerte, providing students with additional notes and exercises at selected points while the videos were viewed.

Typically, the learning resource would present to the student the list of topics and sub-topics with the information as to which of these the student has already engaged with and/or obtained sufficient credit. The student would select a sub-topic and be presented with an initial diagnostic e-assessment (via Dewis). Based on the student’s performance in that e-assessment, the system would direct the student to the most appropriate Xerte resource for further study. The student is then invited to reattempt the Dewis e-assessment, with different numerical parameters, concentrating on the areas they previously struggled with. Once a student has gained credit for that sub-topic, the resource congratulates them and records their achievement. The displaying of appropriate icons by the resource allows the student to keep track of their progress.

It was a pre-requisite of the design of the resource that it be user-friendly. The interface had to allow for easy navigation and awareness of their progress in their learning. For any given e-assessment, consisting of a small number of questions, if a student had previously correctly answered part of a similar question, the student was informed of this. In such a case the student had the option of employing an ‘auto-answer’ feature.

For every programme utilising this feature, there are three mechanisms by which students can use the resource which depends on (typically) the amount of monitoring of engagement required by the programme leader. The three options are:

  • Self-registering. The student accesses the resource via a web address and self-registers. The programme leader can be aware of cohort performance in this situation but cannot monitor individual students.
  • Pre-registered. The system registers a list of student identities and allocates passwords to these identities – typically the identities are supplied to us by the programme leader. The programme leader then distributes these identities to the students. Using this mechanism the programme leader can monitor individual students’ engagement with the resource. This approach is suitable for students prior to them starting at UWE.
  • Blackboard. A web link (LTI) can be put on the programme’s Blackboard site through which student access the system without any additional authentication checks. With this approach, for students with a Blackboard account, students are automatically registered with this learning resource. As with the ‘pre-registered’ approach, the programme leader can monitor individual students’ engagement with the resource.

Below is a snap-shot of the resource. The image is of the front page of the resource for ‘Health Science Apprenticeship’ where the student has started the Algebra topic, gaining full credit in one topic and they are currently in the middle of two other sub-topics.

A guest link (non-monitored) to the resource is available here.

The front page of the resource for Health Science Apprenticeship

Feedback?

To date we have created five separate mathematics resources that have been delivered to ten programmes at UWE Bristol. Student feedback has been very positive:

“I’ve always struggled with rearranging formula so I thought it would be best to go back and study it more in depth and your professionally made video on it has finally allowed me to understand it and comprehend the different aspects of it. … having a teacher with your friendly and calm demeanour would motivate a lot more students to pursue the sciences.”

“I just want to thank you for the interactive video you put up on blackboard. I was really struggling with the trigonometry aspect when going over past papers and I can’t tell you how much this video helped. Breaking it down like this and giving us the option to interact – as well as the automatic pause feature – is just fantastic. Really has cleared things up! I will definitely be using it again to revise.”

Foundation Engineering applicants who had accepted offers at UWE were emailed to congratulate them on their offer (prior to registration) and sent details of the bespoke Mathematics Support resource.  The uptake was very encouraging with 175 out of 182 applicants requesting access. Positives identified by the programme leader included:

“Students felt part of the UWE family very early on and encouraged them not only to complete registration but gave them a positive work ethic and tapped into their early enthusiasm.’’

“As a PL it gave me an initial, individual rapport with the students and demonstrated that our aims on the foundation year is to enable them to succeed, something that some of these students may not have felt in their previous academic year.’’

“Students were conversant with the Dewis format and this helped them with their early assessments in two of their foundation modules.” “The students who completed the online material were very positive about it and said it was useful and some stated that it was just what they needed at that point, to refresh their maths knowledge after a very long summer with no academic work.”

Interested?

If you think your students would find it beneficial to have access to a similar mathematics resource, then please get in touch with rhys.gwynllyw@uwe.ac.uk

We can quite quickly produce a tailor-made mathematics resource using existing content that is relevant to your students.

Why do Students Plagiarise & Purchase Essays?

Posted on

Each year UWE Bristol funds Pedagogic Projects across the University on a variety of themes. In this blog, Jackie Chelin discusses her 2020/21 project on academic integrity.

Why this project?

Long standing issues with plagiarism are being compounded by students’ use of essay mills. There is a real need to help students to understand and embrace the value of academic integrity in their studies. This includes helping them to understand what is and what is not academic misconduct, what is collaboration and what is collusion, as well as how plagiarism might impact their academic progress and future employment.

Crucially, we wanted to hear from the students themselves about the terminology and the activities that would engage them in raising their awareness and understanding, particularly in relation to the merits of good academic, and professional, practice.

What were we trying to do?

  • Understand better student attitudes to plagiarism and cheating and then to work in partnership with them to develop more comprehensive and meaningful guidance and resources.
  • Address the increasing number of assessment offences by taking a student-centred approach and tackling the causes of the problem, e.g., by developing approaches / co-creating resources with students that will help to prevent plagiarism.
  • Complement, extend, and feed into the work of other projects and initiatives across the university.

What actions did we take?

We administered a Qualtrics survey which attracted 323 (anonymous) responses over a three-month period, followed by a focus group with students from all four faculties in which we used case studies to discuss scenarios relating to different types of assessment offence.

We are now working with a group of level 2 film-making students to create an interactive “branched scenario” online resource using H5P technology. Students will be able to travel through this, making decisions at various points that lead them to a better understanding about the consequences of the interactive choices they made, and which they can go back and rectify.

What did we discover?

Students have a wide range of opinions and these are not that different from ours! They are fairly au fait with notions of plagiarism but much less clear on collusion and contract cheating – which might well reflect the relative emphasis we place on these aspects in our guidance and web-based information. Indeed, they want more discussion of essay mills.

Students know quite a lot about the assessment offences process, although not all this knowledge is accurate. They want more training, guidance, and information because they want to do the “right thing”.

Lack of time is a key factor in plagiarism – both in blatant and inadvertent plagiarism. The nature of the assessments that students are asked to undertake also has a bearing, i.e., many students would like assignments that are more meaningful, personal, and interesting to them (which arguably reflects current discussions around inclusivity and decolonisation of the curriculum).

What are we recommending from this project?

There are three categories of recommendations, as outlined below, which could fit into a wider, collaboratively created, university assessment strategy.

In relation to education and guidance, we recommend that:

  • the online interactive resource being created with the film-making students be used, as appropriate, in inductions, embedded into programmes, modules and workshops. This would take the best aspects reported elsewhere and combine this with a more integrated, attractive, and flexible approach (Sefcik, 2020)
  • More support for reading, note taking, paraphrasing, group work, citation and referencing is produced in a range of formats, e.g., online bite-sized resources, for integration into the virtual learning environment, and face to face bookable workshops (both online and on campus)
  • the university develops a repository of sample students’ work to help them to understand what is expected in terms of academic writing and referencing
  • links are included in assessment briefs to relevant guidance and support, particularly to provide clarity about exactly which aspects of referencing and citation (for example) are being assessed, and how.

In relation to assessment, we recommend that:

  • formative assessments be included in the first six weeks of term to provide students with more confidence about incorporating published sources in their work
  • consideration be given not just to the timing but also to the number of assessments students are asked to undertake
  • alternatives, or a choice of assessments, are developed for each module (Bretag, 2019)
  • more advice on assessment design is developed, combined with a review of the coding mechanisms for assessment offences, to be able to trace assessment types that are susceptible to assessment offences.

In relation to communications, we recommend:

  • developing a stronger values-led rather than sanctions-led approach to assessment offences, e.g.
    • the co-creation of an academic integrity policy along with students,
    • the use of relevant social media and student-facing communications to promote the benefits of good academic practice, e.g., deeper learning, personal satisfaction and to support future career (Amigud, 2020).

In making the recommendations we applied an “inclusivity lens” to try to ensure that the outcomes would positively impact all students, allowing them to have access equally, and in an integrated way, to the learning, skills, and knowledge they require, irrespective of previous experience, background, culture, or nationality.

For further information please contact the author of this blog: Jacqueline Chelin, Deputy Director of Library Careers and Inclusivity, UWE Bristol

Visual Pedagogies Project

Posted on

Each year UWE Bristol funds Pedagogic Projects across the University on a variety of themes. In this blog, John Bird and Dave Green discuss their 2020 project on Visual Pedagogies.

Cartoon of an eye

Re-enchant your teaching by using visual materials – photos, film, YouTube, Instagram – in teaching and in assessment…………….make your own visual materials……use found materials……help students to develop their own visual materials

Dave Green and I had been interested in the use of visuals – still and moving images – in teaching and learning for several years before we did the APD project on visual assessment.  We had tried using visuals in a number of sociology and criminology modules, starting with the teaching and moving on to visual assessment. The students seemed to like using the use of visuals and, when we moved on to assessment, were keen to use visuals in traditional assessments – images in essays, for example – but also in some more radical forms of assessment – mindmaps, photo essays. This led to a Faculty of Health & Applied Sciences-funded project on the use of visuals in teaching and learning which culminated in a university-wide Pedagogic Project on visual assessment. This project included a university-wide questionnaire looking at the uses of visual pedagogies; student focus groups across a range of programmes; and a small number of interviews with staff covering undergraduate and postgraduate provision.

Why visuals?  It is increasingly, for students, a visual world and a world in which the majority have  ways of engaging with visual materials and producing their own materials.  We found that students have the basics of what might be called visual literacy which just needs refining.

The use of visuals?  A large proportion of staff use visuals – photos, videos, you tube and so on – in teaching and learning.  Of that proportion, most use visuals to make their teaching resources more engaging; in a sense, the visuals are not integrated and are just forms of illustration.  A smaller proportion integrate the visual and the textual and, in some cases, the visuals become more important than the text; visuals stand on their own as a resource.  The majority of staff do not use visuals in assessment so that even where visuals are fully integrated into teaching and learning, they don’t form a component of assessment regimes. There a philosophical point to this – can we move beyond a point where the visuals we use require a textual explanation! To quote the jazz pianist and composer Thelonius Monk, “writing about music is like dancing about architecture”. In this visual age – that which Otto Neurath termed “The Era of the Eye” – the visual stands on its own and is not reducible to text. The effects of visual pedagogy?  Student focus groups emphasised the positive effects of visual pedagogy on their attendance and engagement and some staff said these pedagogies enhance performance;  students found visual assessment enjoyable and creative; the technologies students use allowing them to become prosumers, that is, producers  and consumers of visual materials which gives them the potential to be co-creators of curricula.

The range of opportunities for visual pedagogy – some things you could try:

  • PowerPoints
  • Pecha Kucha presentations
  • Photos as part of an assessment (what do these photos tell us about ‘X’)
  • Students taking photos to illustrate a topic/theme           
  • Infographics
  • Videoscribe lectures
  • Podcasts          
  • Box of Broadcasts
  • Instagram storyboard/comic strip/graphic novella
  • Selfie – get students to discuss self identity/self concept
  • Street photography project
  • Vlogging/video/photo diary             
  • Visual ethnography of a group
  • Pinterest page or wiki/wordpress                            
  • Cartoons, posters
  • Drama (e.g., group work writing and acting out a case study – social realism)
  • Image analysis: use a methodology, e.g., semiotics/discourse/content analysis to interrogate an image or series of images

Many of these – and there is a lot more things you could try – can be used as basis for teaching/learning and assessment.

It is difficult to sum up what we think we have achieved. What is clear is that a lot of people in UWE are using visual pedagogies – many more than we thought; that students see the visual as an essential element in their learning; that they take very quickly to visual forms of assessment. There are problems: access to technologies; making sure that visual pedagogies are appropriate for a world where there are neuro-diverse students; ethical issues in the making and using of visual images; for staff the time it takes to turn a non-visual form of delivery to one which uses the visual.

Links

These links include a long film we used as a background during open days; some students’ views on visual pedagogy and some examples of visual work we do in sociology.

You can access our Twitter using #social_visual
Engagement with the Twitter account and the variety of Facebook posts, indicates an international interest in visual pedagogies; in addition, we have begun to use visual pedagogies in research, both in the carrying out of research and in its dissemination.  Our hope is that this will widen the public interest in and engagement with research

Contact us:
John Bird (john.bird@uwe.ac.uk) and Dave Green (david2.green@uwe.ac.uk)

Back to top