Hacking Chinese

A better way of learning Mandarin

Benchmarking progress in Chinese to stay motivated

When we set out to learn Chinese, everything we learn is new and we can feel that we improve for each day that goes by, for each time we are exposed to the language. We know this because, in relative terms, we’re learning so much. However, as we gradually advance beyond the basic level and enter the intermediate and advanced stages, this feeling is inexorably weakening and finally all but disappears.

This is a problem, because if we don’t feel that the effort we invest pays off what will then prompt and motivate us to continue learning?

Even though there might be satisfying answers to that question, in this post I will argue that we needn’t even ask the question in the first place if we pay more attention to our progress. I suggest using benchmarking, not to compare ourselves to other learners, but to compare with ourselves at different stages of learning. It is usually quite easy to know that we have indeed made progress if we compare our  language proficiency now with that of the past.

Define your current level for further reference

The first thing we need to do is record our current level in the areas we are interested in. Measuring language ability is notoriously difficult, but as long as we keep the parameters as constant as possible, that will be good enough for our purposes.

Basically, we will device a way to describe our  own ability as best as we can. Then, in a month or a year, we can compare and see if there is any difference. By doing so, we will see that we improve and we will get solid proof that we are indeed still moving, even though it might sometimes feel that we aren’t. Naturally, we might stop moving if we don’t study, but that goes beyond the scope of this article.

Even though this isn’t a scientific undertaking, a scientific approach is essential. For instance, we need to keep the variables to a minimum and make sure that our own ability is the major deciding factor. This means that if we measure reading speed, we should use a text with the same level of difficulty and belonging to the same genre. When we check our current level, we need to make sure to also note how we performed the benchmarking. If we’re going to do this again in six months, it’s likely that we will forget some important parts which make the comparison unfair.

As we will see, benchmarking isn’t straightforward in all cases and requires some further illumination and helpful examples. We’ll start out with the easier kinds of benchmarking (reading and listening) and then move on to more tricky areas (writing and speaking).

Benchmarking reading ability

Reading ability should be the easiest area to benchmark, simply because we can do it entirely on our own without using any fancy equipment. Reading can of course be tested in many ways and here are some goals we can strive towards and measure our progress:

  • Reading easy texts for full comprehension
  • Reading harder texts to understand the gist
  • Reading texts belonging to different genres

These goals can also be combined, but since it would be far too time consuming to try all combinations, we should try to find a few that match our  current goals for learning Chinese. Here are some things we should pay attention to:

  • How often we need to use a dictionary
  • How much time we need to complete the text
  • How we feel when reading the text

Benchmarking listening ability

Listening ability is also a passive skill that we can test on our own. Simply find a suitable audio source and see how much you understand now and compare that with a result in the future. listening ability can incorporate a number of different skills, so here are some distinctions to cover a larger portion of listening ability:

  • Listen to informal vs. formal Chinese
  • Listen once vs. listening many times
  • Listen to a standard dialect vs. regional dialect
  • Listen to texts read aloud vs. natural conversation
  • Listen to content with different topics

Again, since the possible variations are almost limitless, we should examine our goals for learning Chinese, and pick a few that seem the most relevant. Benchmarking is not meant to assess language ability fully accurately, but rather to give us a general idea of where we are. Again, make sure to detail how you perform the benchmarking for future reference.

Benchmarking writing ability

Leaving the more passive realm of listening and reading, it becomes a bit more difficult to benchmark, partly because we cannot or should not rely entirely on ourselves to do the evaluation. Still, writing is in its very nature something permanent that can be accessed at any time. There are many ways to benchmark writing, but I recommend starting a blog in Chinese.

Using a blog, we can have all written Chinese concentrated in one location, easily accessible both to you and others (you will have to share what you write anyway if you want people to comment on what you have written). Exposing your own writing might feel a bit anxious in the beginning, but as I’ve stated elsewhere, be brave and remember that genuine mistakes aren’t necessarily bad.

Try writing texts of different kinds:

  • Write texts in different styles (formal/informal)
  • Write texts on different subjects
  • Write text with or without the help dictionaries
  • Write texts with or without helping friends/teachers
  • Write texts by hand or type using a computer
  • Write in different genres (fiction/discussion/accounts/explanations)

When it comes to comparing texts, there is a certain amount of work that we  can and should do on our own. The obvious thing is of course to compare the level of the texts themselves. Don’t forget to take the circumstances into account here; it’s grossly unfair to compare a polished texts you’ve written with the help of a dictionary and that has been corrected by you teacher, and a text that you’ve written in five minutes by hand without having access to any help.

Still, comparing texts might only give us part of what we’re after, or we may find that we don’t think that things have changed that much. Simply speaking, it might be hard to evaluate our own writing. It’s time to ask a friend or a teacher:

  • Ask a native speaker to compare texts of a similar type
  • Ask a native speaker to comment on what kind of mistakes you do
  • Ask a native speaker to give you an overall judgement of your situation
  • Ask a native speaker for advice on how to improve

Since we want to keep the number of variables to a minimum, it’s strongly suggested that you use the same native speaker (or more than one, if you can). Remember that writing is easy to store, so you can simply select texts you want to compare and send to someone for comparison. You don’t even need to tell them you’ve written all the texts yourself, just ask them to do an honest comparison focused on language.

Benchmarking speaking ability

It’s now time to turn to the fourth and by far the hardest of the four areas we want to benchmark: speaking. As opposed to writing, speaking is in nature evanescent and we need quite advanced technology to record it. This is essential, because there is otherwise no way we can make honest comparisons.

Sure, we can meet a native speaker, talk to him or her, wait a year and then do the same thing. This will yield some results, but will it be enough? Does the native speaker remember how you talked a year ago? He or she probably remembers the feeling of speaking with us, but that’s only half of what we want.

Instead of doing this, I suggest record speech digitally. Again, we should record different kinds of speech, focusing on different aspects:

  • Record your best performance (prepare, record, record again if needed)
  • Record your average reading (just read a text, no second chances)
  • Record improvised speech on a prepared topic
  • Record improvised speech on a random subject

Actually, you can start a blog for this as well, doing a podcast or a video diary or something like that, but some people may find this a bit too exhibitionistic (add a password). The important thing is that we keep our recordings for later. As is the case for writing, we can compare our own recordings, even though that will probably not be enough in itself.

In my experience, this is extremely valuable and I can usually hear many mistakes I didn’t think about when I actually did the recording. Still, that is not the issue here. At some point, we have to include a native speaker. Do the same as you did for benchmarking writing:

  • Ask a native speaker to compare recordings of the various kinds above, preferably a native speaker who isn’t used to hearing you speaking Chinese
  • Ask a native speaker to listen to the various recordings with focus on different aspects (fluency, accuracy, pronunciation, tones, whatever)
  • Ask a native speaker for advice on how to improve

Benchmarking speaking is difficult not only because it involves technology, but also because most people find it unnerving to listen to their own voice. You have to get used to that and you will if you only allow yourself to try. You voice only sounds weird to you the first couple of time. Again, be brave. You don’t need to publish your recordings if you don’t want to, but recording yourself in some way is essential.

Some final remarks

It’s essential that you organise your benchmarking files and keep things tidy. If you’re going to compare texts or recordings that are months or even years apart, you’re going to need a neat structure that allows you to find the files later on. If you think that this sounds like too much work, remember that all the listening, reading, writing and speaking you’re doing is as good practise as anything else.

Good luck!






Tips and tricks for how to learn Chinese directly in your inbox

I've been learning and teaching Chinese for more than a decade. My goal is to help you find a way of learning that works for you. Sign up to my newsletter for a 7-day crash course in how to learn, as well as weekly ideas for how to improve your learning!




21 comments

  1. haton says:

    To assess the extent of your vocabulary, do you know Active Chinese?
    It is a nice tool that quizzes you about Chinese characters and, based on your right/wrong answers, assesses the approximate number of characters that you master.
    It seems the publisher has gone under, but the software is still available on download.com:

    http://download.cnet.com/Active-Chinese/3000-2279_4-10152792.html

    1. Olle Linge says:

      I’ve heard of it, but never used it. Since I store most of the characters/words I learn, I can see fairly accurately how many characters/words I know. However, I realise that most people don’t do that, so thanks for providing the link!

  2. Sinix says:

    I completelly agree, benchmarking is a great idea to keep yourself motivated.

  3. Walid Shaari says:

    how about skitter and its progress metrics, as well as Anaki http://ankisrs.net/ and other SRS flashcard methods. some chinese sites like popup chinese have added a very nice method to gauge ones performance

    1. Olle Linge says:

      You hit on something essential here, I think. Part of the reason why I (and many others) like SRS is that it’s easy to measure progress. We can easily see that we’re getting somewhere, because we can see the numbers of words and characters we know grow. This is great. Still, however useful it may be, SRS can only measure a very small fraction of what we want to learn. What about fluency, listening ability, meta knowledge and grammar? These are the difficult areas.

  4. Craig says:

    What do you think of the ‘official’ benchmarks i.e. the HSK levels and tests?
    I have been using ‘Memrise’ app on iPad with HSK level 1 flashcard set, it is definitely helping.
    Do you think there is value in actually going to sit the official test?

    1. Olle Linge says:

      Yes, sure. The only problem is that you don’t really get to see exactly what you did right/wrong. Of course, a test score is not a perfect indicator of actual ability, but then again, nothing is.

Leave a comment

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.