Tablets in Tanzania

In Education Officers Push for E-Learning, Tanzania Daily News recently reported that the Regional and District Education Officers Association (REDEOA) are promoting e-learning after an agreement was made with Global Education Link. Global Education Link is a company selling tablets, which were were described as a cost effective alternative to books that would encourage students to perform independent research. The tablets are relatively cheap, at 179,000 TZS (roughly 100 USD). The article states that the REDEOA chairman noted that using ed tech devices could allow users to save money since “books and other materials can easily be obtained on the internet in soft-copy unlike existing materials in hard-copy.” However, at TETEA we believe that tablets are not yet a cost effective alternative to schools purchasing textbooks. In 2013 TETEA and MACOBICA purchased a number of textbooks for the library in Maguu. The price varied, but on average the cost for one year of a single subject was around 7,500 TZS (~4 USD). A single student could have a textbook in each of the nine core subjects taught at Tanzanian O-level secondary schools for approximately 67,500 TZS (~36.5 USD), significantly less than the cost of providing a tablet. Another advantage of traditional textbooks is that they lack the operation costs and challenges associated with tablets. Tablets will need to charged if they are to be used regularly. In the more fortunate schools this will result in larger electricity bills, but in many schools charging tablets would be a significant challenge. According to the Basic Education Statistics for Tanzania 2013, 69.3% of secondary schools were not connected to the national grid. Schools with generators could simply require their students to contribute more money to purchase fuel, but the schools which have solar panels, biogas, or windmills might not be able to generate enough electricity to regularly charge tablets for every student. The schools without any electric power available would not even be able to contemplate using tablets as a replacement for textbooks. Tablets are also more prone to maintenance issues. Batteries will eventually need to be replaced and screens will crack. On the other hand, the most maintenance that textbooks need is having their binding resewn and maybe adding a protective cover of cardboard. Finally, there is currently a lack of free educational materials targeting Tanzania available in soft copy on the internet. There are some notes, past examinations, and study guides on ShuleDirect and TETEA’s resource website, but to our knowledge there isn’t much else. The article mentions that secondary education textbooks will be built into the device, but since the devices are relatively expensive (compared to paper books) we feel that there should be more content tailored to Tanzanian students to make them worthwhile.

2014 Form 4 Results

Form 4 examination results (mirror at maktaba.tetea.org) were released on February 14 and articles describing the announcement made by the government have been printed in several newspapers (See References). The Executive Secretary of NECTA declared that the pass rate for 2014 national examinations was 68.33%, a 10% increase from the previous year. This pass rate is just shy of the government’s Big Results Now (BRN) goal of a 70% pass rate this year. While this may look like an improvement, and was presented as such in the articles, a closer look at the numbers reveals that student performance decreased. The total number of students who passed the national examinations fell from 201,152 in 2013 to 167,643 in 20145. The increased pass rate isn’t due to improved performance by the students, but rather the result of a significantly smaller number of students sitting for the examinations. While the group of students who finished in 2014 entered O-level with a larger class than the previous year,  they were required to pass their Form 2 examinations in order to continue to Form 3. Many of their classmates were forced to repeat Form 2 or end their studies after failing the examinations. The students who finished in 2013 didn’t have this condition so most of their class continued to Form 4 and sat for the examinations. The figure below shows the stark difference in the transition between Form 2 and Form 3 for the classes of 2013 and 2014 (examination statistics are from 5 and enrollment numbers from 6).

form4Results

  The government has been using the pass rate (the number of students who successfully pass the examination over the number of students who sit for the exam) as the metric to define school performance and the health of the education sector as a whole. However this doesn’t seem to be a good statistic when comparing the O-level results from the past two years since the attrition rate before Form 4 was so different. Contrary to the announcements in the press it seems that the CSEE examination results have deteriorated this past year. In the U.S., one of the measurements used to evaluate schools is how many students graduate after 4 years. Looking at the CSEE results in this way paints a different picture. In addition to fewer people passing the examinations in 2014 than in 2013, the numbers also show a drop in the percentage of students who successfully complete O-Level. Looking at last year’s exams, 45.8% of students who started Form 1 in 2010 went on to pass their Form 4 exams. For this year, the percentage dropped to only 35.9% of students who started Form 1 going on to pass their Form 4 exams. This represents a drop of nearly 10%. While people may point to the increased pass rate as a percentage of students taking the exam as evidence that BRN is working, the increase in pass rate can be traced back to the 2012 decision to only permit students who pass the Form 2 examination to join Form 3. The truth, however, is that there are more students who are not finishing their secondary education then there were a year ago.

References

1. Notable Improvement in Form Four Results, Daily News 2. Shule Binafsi Zatesa Matokeo Kidato cha Nne, Mwananchi 3. Matokeo Kidato Cha IV: Shule za Serikali, Seminari, Vipaji Maalumu Zaporomoka, Mwananchi 4. O-level Results: Girls, Private Schools Shine, The Citizen 5. Ufaulu Kidato cha Nne 2014 Wapanda kwa Asilimia 10, EATV 6. 2013 Basic Education Statistics in Tanzania, retrieved from moe.go.tz (currently undergoing maintenance)

Relative Smartphone Penetration in Tanzania

Smartphone penetration in Africa has been rapidly increasing the last few years. Tanzania is no exception; smart phones are common in cities and especially among youth who are studying in, or have recently completed, higher education. According to an article in the Tanzania Daily News the smartphone market in Africa has been growing 19% annually and the increase in availability of cheap smartphones is expected to continue this growth. The map below shows our estimate of relative smartphone penetration by region. We generated the estimate from Google Analytics data on our resource website. This year we mirrored the Primary School Leaving Examination results soon after they were posted by the Tanzanian government. The results are structured in such a way that a user selects a region and then district before receiving a list of schools. We took the Google Analytics data for just the region webpages and filtered them to give us the unique pageviews by mobile devices. Then we divided the unique pageviews by mobile devices by the number of students who had registered for the examinations in each region (which was scraped from the results). Finally, we divided by the region with the highest ratio to normalize the data.  
Some caveats to the map:
  • There were a relatively low number of visits to the site for some regions (three were visited less than 200 times). In total there were just over 10,000 unique pageviews for regions compared to 792,122 pupils who sat for the exam. It would be much more instructive if the government did a similar analysis on their website which undoubtedly receives significantly more traffic.
  • The data is probably skewed by private schools. Even at the primary level some wealthy parents (who are more likely to own smartphones) send their students to private boarding schools. Private schools aren’t evenly distributed across the country, so regions with a higher concentration of elite schools (e.g. Dar, Kilimanjaro, Arusha) may be getting hits from parents who live elsewhere.
  • Within regions there is a high degree of variability. For instance in the Kilimanjaro region our estimate of smartphone penetration is 2.2 to 5 times higher in Moshi (the regional capital) than other districts. A similar map using districts would highlight the locations of larger cities while most of the country would have even smaller penetration ratios.

Free Secondary Education?

The Tanzanian government has committed to providing secondary education for free starting in 2016, as was reported in Free Secondary School Education Spot On. This will certainly be a popular move by the government, both among donors and the general population. However, it remains to be seen whether secondary education will truly be free. In 2001 the government declared that primary school would be free the following year. While government schools did stop requiring school fees, many schools had (and continue to have) mandatory contributions [The Cost of a ‘Free’ Primary Education in Tanzania]. While contributions are slightly different from fees in that they are not imposed by the government itself (but rather the individual school), in practice they have the same effect – students must fulfill the contributions or risk being barred from classes. Some of these contributions can be physical items (e.g. paper or stools), but often money is collected for a variety of reasons like lunch programs (paying cooks and purchasing cooking oil, salt, etc.), security, and paying per diem to teachers attending conferences. These required contributions continued and were often increased to offset lost revenue from the eliminated school fees. At the secondary level there are even more mandatory contributions; some schools can have a half a dozen or more different funds to which students are required to contribute. As a result, it is not uncommon for mandatory contributions to be greater than the fees at secondary schools. Hopefully the government plans to eliminate both fees and mandatory contributions, otherwise this new initiative will not result in secondary school being affordable to everyone. Furthermore, there is the potential for effectively no difference in the financial burden for parents if schools are allowed to increase the amount students are required contribute.

2014 PSLE Regional Performance

Last month the Primary School Leaving Examination results were announced.  A number of articles reported on the top performing schools and regions (see: Standard VII Results Improve by 6pc) and NECTA has posted a map of pass rates by district to show how performance varies geographically.  While pass rate is the most used statistic when describing examination results, presenting a single number doesn’t give insight into how a population is distributed. One way to graphically display distribution information is a box and whisker plot.  In the simplest type of box and whisker plot, the ends of the whiskers (the lines extending either side of the box) show the minimum and maximum values of the dataset.  The box itself has three horizontal lines indicating the first, second, and third quartiles (Q1, Q2, and Q3), which are the points that divide an ordered set of data into four subsets with an equal number of elements.  The second quartile, which is the horizontal line inside the box, is the median.  For a more detailed description of box and whisker plots check out the Khan Academy Videos on the topic. Below is a box and whisker plot that shows the distribution of school averages in each region of Tanzania.  In the future we’ll make another plot using pass rates for each school, but for this initial attempt it was easier to scrape the averages as they were already calculated and posted on the results page for each school on NECTA’s website (example page). schoolAvgsByReg5   Dar es Salaam, the country’s economic capital and largest city, is clearly the dominant region.  Dar’s performance comes as no surprise; schools in Dar have historically had much better student-to-teacher ratios, educational facilities, and resources.  Still, it is surprising to see how much better the schools performed in Dar compared to other regions.  Dar’s worst performing school has an average that would earn it a rank near the median in almost a third of the regions and in many others it would still have a better performance than a quarter of the schools.  The plot also shows that the Arusha and Kilimanjaro regions, while performing well, did not score significantly higher than the other regions outside of Dar.  These two regions benefit from a number of tourist attractions like Mt. Kilimanjaro and the Serengeti, which has resulted in a higher density of NGOs and better road networks.  However, it does not appear that tourism (and the money and development that usually accompanies it) has had a significant effect on primary education, as the results for Arusha and Kilimanjaro are comparable to more remote regions like Kagera and Mtwara.  There are concerns regarding the data used to create this plot.  One concern is that some of the schools had few graduates, in which case a single exceptional student could have a large impact on the school’s average.  Nearly 200 schools had eight test-takers or fewer, including three schools (like Sangasanga) that only had two students take the examinations.  Another drawback of this particular chart is that it includes both government and private schools.  It would be preferable to plot the data from government schools only, as private schools, which are unevenly spread throughout the country, typically have dramatically better scores.  Still, in its current form the chart has the benefit of showing what education opportunities are available in each region.