## Saturday, December 24, 2011

### "I think I discovered a theorem, Mr. Karafiol!"

## Friday, December 16, 2011

### Low Tech, High Impact

- Students get to see a variety of problems worked out carefully, and ask questions in a nonthreatening setting. And while they're not grappling with each individual problem, the more questions they ask and answer, the more they think through the problems presented--even ones they didn't work on.
- Students work on communication skills. In other instructional models, it's rare to have an entire student response of this length subjected to a full-class critique.
- Students focus on one problem for enough time that they can think deeply about it, and transfer the ideas to other contexts.

- Students needed to understand and be able to recreate the major steps in solving any calculus optimization problem: identify the constraints and the objective function, rewrite the objective function using a single variable, and apply calculus to find the maximum or minimum value.
- Students needed exposure to standard problems, both in case they should encounter those very same problems later, and to provide foundational experiences from which they could build out to other, similar but perhaps more-complicated situations.

## Sunday, November 27, 2011

### Homework and more homework.

- Homework is necessary. Students need time, on their own, to wrestle with mathematical ideas, to put them into perspective, connect them to other ideas and to practice. Some of this can happen in a class, but it is the rare students indeed who is able to make connections and internalize concepts in one class period.
- It needs to be done on a regular basis, so students come to class knowing more than they did when they left class the day before. Otherswise there in not much progress happening.
- It needs to involve reading and learning from reading. A students who can not read text, study an example, and determine meaning, is not an independent learner and will be forever limited in his or her ablilty to further advance his or her education.
- Students need incentives to do homework in mathematics even though they know it is helpful and important. They are human and they are immature. Given the choice, they will usually do something that is more social or more to their own interests than doing the problems that the teacher requires that they do. Even my best students, when homework was not required, spent their time doing the Chem assignment or writing the history paper that was due tomorrow, instead of the math, if they could put it off for another day. "Never put off until tomorrow what you can just as well do the day after tomorrow." --Mark Twain
- Homework is a learning experience, not an assessment activity. As such, it should not be graded. It should be evaluated in proportion to the effort that went into it, not in proportion to the number of correct answers.
- Students need feedback with regard to the correctness of their work.
- My time, both in and out of class, is better spent writing interesting problems, asking good questions, and writing appropriate assessments than it is spent grading homework.

## Friday, November 11, 2011

### Of Babies and Bathwater

These last two weeks have been busy with end-of-quarter grades, projects, etc. (A forthcoming post will be "High-school level projects that involve actual mathematics," but I digress.) This post is reflecting on the not-entirely-successful first iteration of our "no homework grade" policy: nightly homework assignments don't count towards students' grades, but frequent unannounced quizzes use representative homework problems as an incentive to complete assignments and an assessment of whether students know how to do the math.

The data are in and the following seem clear:

- Students are completing less homework. How much less is unclear, because in the past, the marks on students' papers didn't always correspond to thoughtful effort expended on mathematical problems, but in my upper-level classes, it's typical for only about half the students to have attempted a significant number of problems, and in previous years, it was more like 80%. In the past, I doubt that the typical homework assignment was copied/scribbled from answers by 30% of my students. Lower-level classes are doing better on most days.
- Students perceive the policy as "you don't have to do homework," which seems like a misreading to me. More accurate would be "homework isn't graded and factored into your overall grade."
- Students are doing less well on in-class tests than they did on last year's tests, although results vary by class. Classes that are giving a lot of homework quizzes are finding less dropoff, but those same classes have younger students.

*So Much Reform, So Little Change*, Charles Payne dissects the etiology of failed reform efforts, discovering that a pervasive symptom is simply discarding changes that don't work, rather than examining and adjusting them. In that light, our department is trying to revise our new homework strategy rather than revert to one we found problematic. Some questions and possible answers:

1. Why don't students do homework under the new policy, when they can see their grades dropping? First, they may not see the connection between doing homework thoughtfully and actually getting better at math: it's telling that large numbers of students describe the policy (to parents, counselors, and teachers) as "you don't have to do homework" rather than "homework is important to learning, but you're only graded on what you learn, not what homework you do." Second, they have a lot of other work--we're suffering from being the "first movers" in responding to

*Race to Nowhere.*When a student is up at midnight and choosing whether to do math or go to bed, the threat of a possible homework quiz is clearly not enough incentive to do a handful of math problems.

2. What can we do to improve the situation without throwing everything out? First of all, we can communicate better about what we think it takes to learn serious mathematics. Maybe we should take a cue from the advertising folks, and make posters saying "192 minutes is not enough" or comparing time spent doing math to time spent doing other valuable activities? What if we change the homework quiz policy so that homework quizzes are frequent but expected, for example every Monday and Friday? What if we specifically identify which homework problem serves as the basis for each quiz question?

3. What other ways are there to get students to do math outside of class without increasing incentives to cheat or skate by? Webassign?

This is a tough time for us: we want to do things differently and better, so we need to figure out how to adjust our course rather than simply u-turning. Any ideas and suggestions are welcome; we'll take them in the comments.

## Sunday, October 23, 2011

### Presenting proofs 2 etc.

I applaud P.J. for working through the proof of Brahmagupta's formula with his advanced students, even though it was perhaps not in line with what we call "best practice," as many of his students may not have understood.

First and foremost, one of the most important things we can do for our students is to share our enthusiasm for mathematics, perhaps even mathematics they do not at this point completely understand. Knowing P.J. as I do, I'll bet his students were as excited by his excitement as they were by the beautiful proof he shared with them. I am sure he did not just stand at the board with his back to them writing. Probably didn't even use a board.

Secondly, it is critical that every student see some beautiful and significant mathematics. Part of being educated is understanding where knowledge comes from. How is it that we come to know the things we know? How did we come to think this way? How did anyone ever think of that?

Seeing a beautiful--if complex--proof is as important to an education as seeing a complicated, if not completely understood painting, perhaps a Picasso, or a DeKooning. Seeing a beautiful proof is as important as hearing music written by Schoenberg or played by Charlie Parker or Ornette Coleman, or attending a play by Beckett or Shakespeare. The proof or the painting or the music or the play may not seem beautiful the first several times we encounter it, but we are aware that creativity and beauty are present, and sometimes it takes us work and time to take it all in. When the complex, beautiful thing does make sense to us, we are changed. That is a part of education. Not the part that will necessarily make a lot of money, certainly not a part that will improve our test scores on a high-stakes test, but a part that will improve the quality of our lives.

Mathematics is overflowing with creative ideas and contributions from creative people. People like Cantor, Godel, Gauss, and Newton had some amazing ideas and made some remarkable contributions. Mathematics teachers have a responsibility to make our students aware of the inventive nature of mathematics, and it is easiest to do so if we share the problems and proofs we love. I used to teach a unit on non-Euclidean geometry just because I liked the ideas so much. A few of my students grasped what I was telling them and studied it further. I suspect others did much later in their lives, and I just have never heard.

I recall my Modern Algebra professor, Dr. Pilgrim, comparing a proof he had just showed us to a Gail Sayers run he has witnessed the Sunday before during a Bear's victory. His comment stayed with me and made me take a harder look at proofs. As it happens, I have made a list of my favorite mathematics. In the top ten, seven are proofs. I didn't always feel that way, but then I didn't always love mathematics the way I love it now. Mathematics has clearly made my life more interesting and the opportunity to share that with other people has been even better.

I rarely share those proofs with all of my students because I know that the timing has to be right in order to have in impact. Many students shut down as soon as they see a proof coming. It is such a shame that they are missing out on such enjoyment. But then a lot of people don't listen to jazz, classical music, go to art museums or serious plays either. I find all of those interesting and fulfilling. I am sure there are things I am missing that are equally important, but no one ever hooked me on them. Such is the way of the world. All I can do—and I must do it—is to try to share with others those things that bring me such joy and hope some of it will rub off, so we can share it together, and so they can keep it going.

This weekend, I attended the Illinois Council of Mathematics Teacher's annual conference. One session I attended was organized by Doug ORourke, a good friend of PJ's and of mine. Coincidentally, part of what he offered was an opportunity to investigate Hero's formula and Brahmagupta's formula in a new and different way. He proposed several versions of what could have been the formula and challenged us to find a way to explain why each variation of the formula could not be correct. The discussion was stimulating and resembled the discussion that comes before a proof and rarely happens in any math class. He then took Brahmagupta, had us enter it into a CAS calculator and then enter all sorts of numbers, to see what would happen. The overriding theme was Plausibility. By this he meant to look at special cases, impossible cases. What a brilliant way to spend an hour. Thanks Doug and I shall take this with me.

Friday evening was devoted to awards. The outstanding secondary School teacher award went to Natalie Jakucyn, truly a giant among us. In her acceptance speech, she thanked her high school math teacher, a nun who held her students to very high standards. Natalie recalled the day Sister put a long proof on the board. When she was done, the Sister wrote, "QED," went the back of the room, and said "Isn't that beautiful?" It was then that Natalie decided to become a math teacher!

So, thanks again, P.J., for taking the time out from the usual hands-on, engaging, student-discovery type of lesson that is typical of your classes and inspiring at least a few of your students by showing them a proof. Do it again. No one should graduate from high school without seeing Euclid's proof that there are infinitely many primes. It is certainly a proof that is in "The Book." and has inspired many a fledgling mathematician. And an important part of excellent teaching is inspiration.

## Sunday, October 16, 2011

### Presenting Proofs

^{th}and 12

^{th}grade students who have finished Calculus, or who are gluttons for more punishment than a single math class a day affords. And while much of their work is either a group discussion, or quasi-independent—they spent most of this week working on proving concurrences and collinearities they selected from the book

*99 Points of Intersection*—every so often I find myself doing what was done unto me in my college math courses: presenting the proof of a theorem.

*103 Trigonometry Problems from the Training of the USA IMO Team*—was one of my best. I put the trigonometric steps first to motivate the brutal algebra, and many of my students were able to stay the half-step-ahead that’s necessary to fully understand a proof. (That is: they understood not only why a particular step was justified, but why it might be desirable.) Cheers came at the end; one student stood up and shouted “That’s freakin’ awesome!” A good class, right?

^{1}A few saw ahead to the fact that factoring complicated polynomials is almost always more useful than multiplying them out. Frankly, there was no real assessment, so I can’t even say with confidence what any particular student took away, other than awe. Really, at base, they watched me produce a proof.

*besides*the capacity to generate X or something like it.

## Sunday, October 9, 2011

### Homework

## Sunday, October 2, 2011

### Checking In...

1. In our geometry classes, we've agreed to stop giving traditional "points" grades, and instead give students grades based on our assessment of their proficiency in (for this semester, 19) predefined outcomes: skills we expect them to master, or concepts we expect them to understand and apply. Quiz questions, for example, now refer to outcomes ("1a") rather than points ("3pts"). We assess overall proficiency at each outcome based on a student's most recent work, not an average that includes failed attempts. There have been some logistical glitches, due in part to our district-wide grading software. And there are some things we won't do again: give a quiz with five different outcomes on it, for example. But I've noticed two positive effects:

- After giving a quiz, I'm much more aware of what kids know and don't know than I was in the past. The simple act of recording, for each student, what his/her performance was on each assessed outcome, has helped me focus in on what I've successfully taught and what needs further teaching.
- My standards have gone up. Before, I'd sometimes give an answer full credit--or mostly-full credit--even when it wasn't exactly what I was hoping for, thinking "Well, is this issue really worth 1/2 of a letter grade?" Now there's no averaging, and kids are, in principle, free to try again as many times as they need to. The result is that I hold out for answers and explanations that are well-nigh perfect.

- After an initial drop in HW effort, it's coming back up. And students appear to be doing homework more mindfully: they come in with six or seven problems done, saying "I knew how to do the rest" or "I figured I needed more practice on this." Though I'm still seeing less homework than I did under the old check-for-completion system, I'm not sure I'm seeing less actual work: before, many students rushed assignments, or copied answers from the back of the book (or their friends) just to have something to turn in.
- Because I'm quizzing more often, I have a better sense of what kids can actually do. We're retooling the lessons this year anyway, but now, our conversations usually start with a discussion of the most recent HW quiz. And grading is fast: I usually find I can grade two classes of two-question quizzes in under 30 minutes.

## Monday, September 12, 2011

### Give this a try this year, if you haven't already

The teacher you invite need not be a math teacher. I learned some very interesting things one year when I visited two English teachers, an American history teacher, and a physics teacher. My goal that year was to learn how to get my students more involved in discussing what they were thinking about. I asked students and other teachers who in the school was particularly good at fostering class discussion, and I came up with four names. All four teachers did things I didn't expect; all four classes were thoroughly enjoyable; all four had totally different styles of teaching. One of the English teachers had a chair with wheels, and he scooted around the room and sat directly in front of the student who was speaking, as though it were a private conversation between him and the student. Another teacher had students sitting in rows while he stayed in the front of the room. The students seemed to be enthralled with the class, as was I.

## Tuesday, September 6, 2011

### Two things for (from) your first day...

First, micro: do actual math on the first day. It's easy to get caught up in going over rules, procedures, grading standards, etc. But why do we implement those systems in the first place? For the most part, the point is to ensure that our students do, actually, learn some math. How ironic to then spend the first day not doing math in order to communicate that math is the main thing! Much better is to communicate that math is the main thing by actually spending a chunk of the period doing math!

*(For the record, I doubt that going over lists of rules or procedures is even helpful. I myself have a personal capacity of learning about five rules, procedures, or standards at a time--tops--and maybe ten per day. I doubt most students are much better. Even at just two rules per period, the students are effectively done by lunchtime. So there's no point in going through every detail; instead, provide a handout with the fine print, mention the big picture, and make sure to go over rules as (just before) they come up.)*

This math doesn't have to be hard. In Geometry, we go through a sequence of folds on a circle and talk about angles, symmetry, terminology, etc. It's a great pre-assessment of what kids know coming in, and it allows us to "get through" a lot of vocabulary in a context where that vocabulary is meaningful. In Calculus, we watched a video of a speedometer:

and a video of my dog's ability to do calculus while fetching a ball--which wouldn't upload, so here's the original "Dogs know Calculus" video.

- use videos (á la Dan Meyer), or
- incorporate more formative data into your lesson planning, or
- plan quizzes and tests collaboratively, or
- create tiered work on which students can select for themselves the appropriate level of challenge (aka Challenge by Choice), or
- design (or borrow) writing prompts that get students to think mathematically, or
- anything else you haven't done very well before, like in that cool presentation you heard at last spring's conference.

Good luck, and do some great math! In the comments: what math did you do on the first day?

== pjk

## Sunday, August 21, 2011

### Back to School

Still, the first day is the most important day of the year, and I miss it. I always worked hard to have an interesting lesson that would surprise my students, excite them about the possibilities for the coming year, and give me a chance to meet them. I did not go over rules nor did I have non math getting to know you activities. We did math. I wanted to set the stage for them. It worked.

## Sunday, August 14, 2011

### The Talent Equation

*skeptical*about talent, but even that isn't quite right. So here's what I've come to believe.

First, a basic question: what is talent? When someone gets an A on a test with little or no effort, we say either "the test was easy" or "she's really talented." When someone puts years of effort into lab work -- or proving a theorem -- and comes out the other side with an amazingly mind-bending result, we say "Sure, she worked hard--but she was also brilliant to have seen ... " In both cases, talent is what bridges the gap between the effort somone has put in and the results that come out. We can express that thought in something like an equation:

*explaining something:*why Jane can work in the lab for ten years and come up with only incremental results, while Jeanine works in a similar lab for ten years and revolutionizes her area of research. In the classroom, when we say "Jimmy is more talented than Jeff" what we usually mean is something like "Jeff studies for a test and Jimmy doesn't, but they get the same grade."

Notice that the word "talent" (or phrase "more talented than") doesn't necessarily refer to any particular characteristic or set of characteristics, even in a single field such as mathematics. Some kids have good number sense; some are good at seeing patterns; some are good at recalling any idea or problem they've seen once; some can gnaw on a problem for hours or days without getting overwhelmed; some have great metacognition about what they need to improve and how to improve it. All of these are talents, and for any combination, I can think of a student I've taught. I think teachers in particular toss this idea (as well as "smart" or "bright") around without even thinking carefully about which talents or strengths they are

*trying*to refer to. In my view, simply calling someone talented (or "smart") is intellectually lazy.

It's also useless, to the student--because it doesn't reinforce the actual behaviors that need reinforcing, or point to other areas in which he or she could improve--and to other students--who are led to believe that student X has some "special thing" that nobody else has--and to the teacher, whose job is to strengthen the student, not just praise him or her for what he or she already does well (right?).

Talking about "talent" or "smarts" is actually counterproductive because it reinforces the false notion that great achievements are primarily the result of talent, when in fact virtually every great achievement is the result of years, sometimes decades, of sustained hard work. Genius/smarts/talent are only invoked to explain why Einstein (or Marie Curie, or Andrew Wiles, or...) achieved the great results they did when other people who worked just as hard got nowhere. But because we can't point to one or even a few specific things that talent consists in, talk about "talent" doesn't help us identify people who will be successful ahead of time. And in fact I think that we as math teachers are pretty bad, demonstrably bad, at identifying those people ahead of time, especially when those people are girls, or slightly-rambunctious boys, or nonwhite and nonasian. (See Lee Stiff's article here.)

So when I say that I'm skeptical about--or I don't believe in--talent, what I'm saying is that talent-talk misses the point rather badly. The real point is hard work, which for some people will result in great achievements; because hard work doesn't do that for everyone, we explain the disparity as a combination of luck, timing, and talent. Any task worthy of the name requires concentration, effort, and persistence. Talent isn't the point; hard work is. Going back to the second equation for a minute, we can rephrase the algebra as an analect: talent is the capacity to achieve great things through hard work.

Now that's something I'd hope we'd try to teach everyone.

## Sunday, August 7, 2011

### Hard work

Many of those who put in extra time did so because they enjoyed the work. A friend of mine who is an excellent piano player has told me that when he was a child, he couldn't wait until he got home so he could play the piano for several hours. Over the years, I have noticed that many outstanding math students get very excited when telling me about one of their mathematical discoveries. They didn't do the work that led them to these discoveries because they thought it would make them better at doing the work as much as they did that work because they enjoyed doing the work. I see two consequences to this observation.

The first one is that teachers need to put more emphasis on interesting, challenging, intriguing problems; if they do, the mandated test scores will take care of themselves. Drills and practice just are not going to motivate more practice. They will drive children away from our subject and convince students that they are not good at math, and that they don't even want to be good at it because it is boring. (I just googled "boring math class" and got 46,000 hits.)

The second consequence is related to recent work by Keith Devlin about the potential impact of elctronic games on middle school education. I heard him speak at NCTM and read his book, Mathematics Education for a New Era: Video Games as a Medium for Learning. Among other things, he points out that people willingly play video games for hours on end, and that when they do, they get immediate feedback. They also expect to fail at what they are doing for quite awhile.

A teacher's main job is to pull students in to the subject being taught, to ask them interesting questions, and to let them learn. That means the teacher's main job is to provide students with interesting tasks that students can relate to. Some of these tasks should be problems that relate to their world, and not just school. Some of these tasks should be puzzles and open-ended questions that might take weeks to solve. Perhaps just posing a situation with a photograph or a short video and asking them to ask questions about it will engage them. I am particularly taken with the idea that we need to let students ask some of the questions as part of our regular routine, instead of only requiring them to answer the questions we ask.

Two weeks ago I had the pleasure of being at a talk by Dan Meyer. He raised some of these same questions about getting students involved. In particular, he pointed out that we often break a problem down into so many little parts (scaffolding I think it is called) that the student isn't sure what the real point of the question is and never has to figure out how to solve it. Part of being interested is to figure out what needs to be done. We are so afraid that students will fail that we drag them through every step of the problem in hopes of keeping them from being frustrated. Being frustrated is part of the fun and a valuable part of the experience.

If students work hard because they want a good grade, or because they want to please a parent or teacher, or because they have bought into the belief that hard work will get them a good job, they will stop working as soon as they have made progress toward their goal. If students work hard because they find the work challenging and stimulating, they will keep working no matter what. I think the latter motive for doing work is worth cultivating.

## Thursday, July 28, 2011

### "To study for ten years at a cold window..."

*more*math, which is pretty much the only way I know to get better at it.

*hours*every week: at least 10 or 15 more than required for class and math team, so about 12-17 more hours each week, at least, than most "ordinary" math students at my school. Over four years, Alex spent

__at least__2400 more hours thinking and working about math than the typical math student at my school. Of course he was good at it! He'd have had to have--quite literally--some kind of learning defect if that much work

*hadn't*paid off.

- We're not very good at discerning talent, unless it comes packaged in very recognizable shapes, sizes, and containers. Quick at arithmetic, good at spotting patterns, doesn't need to show work--these are all recognizable, and so we spot those relatively easily, especially when the person is someone whom, because of our own biases, we are likely to think of as good at math (e.g. white/asian, male, etc.). But: other mathematical talents, such as the ability to generalize and synthesize different results, to construct arguments containing multiple ideas, to sift through different approaches for the most fruitful one--these don't show up as early and are harder to see. In fact, by the time a student is old enough to have encountered a mathematical situation for which these talents are valuable, he or she may already have been "tracked out" of the highest-level mathematics. And again, we're even less likely to spot a student with these talents who's African-American or Hispanic, or not a boy.

- Math is too hard for sheer talent to get most people very far. Alex
*worked*on his ideas and chased them down until they made sense. Discovering and writing a good proof can take hours even when the problem is just a college-level exercise--much less a Putnam problem or (gasp!) an actual theorem. The people who make it to the ends of such journeys aren't the ones who start out the fastest or the furthest ahead; they're the ones who don't give up because of their passion for the subject and their determination to keep going. That's where the ten years comes in--whether it's in a study in Princeton, or by a cold window in Xiangsu province.

*Nurtureshock*authors go even further, citing research that telling kids they're smart actually

*decreases*future success.

__if they work hard__. And that's a message I think all of our kids should hear.

== pjk

## Thursday, July 21, 2011

### Something I found interesting

The article on the cult of self-esteem makes a lot of sense to me; it ought to be brought to the attention of anyone who is involved in the life of children.

"The World's Schoolmaster" is also noteworthy.

Perhaps the most interesting article for me is "The Brain on Trial." Although the article focuses on criminal behavior, I couldn't help but think about P.J's earlier blog about the students he just doesn't reach. I also thought about many of the students I just couldn't understand.

As well, there is a short piece on the public employee as the new enemy that many of us will find interesting.

There are also lots of other fascinating articles that did not relate directly to mathematics education but were otherwise interesting; I hope you find it as thought provoking as I did.

## Saturday, July 16, 2011

### The impact of data

http://youarenotsosmart.com/2011/06/10/the-backfire-effect/

It is a very interesting take on why and how we resist data that tells us things that run counter to what we want to believe and on what happens when we encounter data that provides evidence for something we do not want to believe.)

I have two initial thoughts about this data-resistance.

First: let us get to the heart of what we do as teachers. We wish to provide our students tools so that they can make intelligent decisions as they live their lives. We want them to learn to think clearly about little things and big things, so they can contribute to society at large and so they can make good personal decisions regarding their well being and safety. I hope everyone agrees with that. As a result, we teach students how to collect, analyze and draw inferences from data. The assumption is that if they understand what is true, then they will make informed decisions. It appears that we are wrong. There is considerable evidence that people will ignore data and continue acting according to old habits. Even intelligent, well-informed mature people will ignore the research if it provides an "inconvenient truth." Why is this, what can be done about it, and what are the consequences for education?

It seems true that people trust their own experiences much more than they trust research, most likely because that--experience--is the way we learned to learn. Children try to walk: they fail; they try again until they get it. They learn that the way to learn is to try and to trust experience. Not only does the child learn to walk, talk, and generally function in the world, but the child learns a good way to learn, namely: try, and then trust personal experience.

Second: most classroom teaching is still approached in one way: there is stuff to be learned; it is the stuff that the curriculum wants students to be learned; we have an obligation to have our students learn it. The students usually do not experience the curriculum. That means they might not believe it, because it is not something they personally experienced. If we want students to believe data and live by it, then students need to experience it. That means that we need lessons, beginning at a very young age, in which students state their beliefs, students collect data, the data contradicts those beliefs, and then the students have a way to test their beliefs against the data. The best example I can think of has to do with physics and falling objects. I think of these because they confronted my beliefs when I was a child, and I still remember being proved wrong. There was an exhibit at the museum where one ball was dropped and another was projected from the same height at the same time, and both balls hit the ground at the same time. I had to see the demonstration several times before I could accept the new information about how gravity worked.

The problem is further complicated by the way our culture celebrates people who just have a "gut feeling" that they should try something, and when it works they are celebrated as heroes. A particular instance of this is found in the book Moneyball, where the baseball culture ridiculed and ignored evidence that ran counter to long standing beliefs about baseball, even though considerable amounts of money were at stake.

Even the stories of great scientists seem to celebrate hard work and good fortune rather than a careful analysis of data. Perhaps we need some more stories, plays, films and TV shows about the importance of careful analysis of data.

There may be no better reason to reform mathematics education than to restructure what we do so that our students learn to look at data and make intelligent decisions accordingly.

## Thursday, July 7, 2011

### Resistant to Data

*data-resistance.*Data-resistance is when people--educators, parents, students, whatever--are so gripped by their preconceptions that they overlook or ignore data that suggest a different general picture from the one they are used to.

Here's an example. Several years ago, Chicago Public Schools created a new, free, voluntary summer program for entering ninth graders. The program lasted four weeks, and -- as implemented at my school -- was well thought-out, addressing academic, social, and emotional needs, with support in particular content areas (math and English) as well as general discussion and practice of academic strategies. I helped work on it, and I was really excited about the program. Everyone agreed it was a terrific success.

The following academic year, I followed up by gathering data. For each student, a counselor and I collected first semester GPA and number of courses failed,and we looked for differences between the 100-or-so students who attended the program and the 100-or-so students who didn't. We couldn't find any. We went back to the database and sorted students by F/R lunch status and by score on the qualifying entrance exam, and in no subgroup did students who attended the summer program do better -- either higher GPA, or fewer failures -- than students who skipped it. Statistically, there was no difference between students who attended the program and students who didn't. In face, we couldn't find a single academic measure on which there was a difference.

As we started discussing whether and how to implement a similar program the following summer, I took my data back to the planning team and said "Look, we all thought this program was terrific, but in fact it doesn't seem to have any impact." The response was uniform: it's a great program; we should do it again; we shouldn't make major changes.

That's what I call resistance to data.

Now it's possible that there are other ways in which the program was helpful. Maybe students who attended the program found the first weeks of school easier, or more enjoyable; maybe they got more involved in extracurriculars. But nobody suggested that there were data supporting any of these claims, and -- one could argue -- if these outcomes don't show any ultimate academic impact, there might be easier and less-expensive ways to attain them. Here's another hypothesis: maybe having half the class attend inculcated a culture that "infected" the whole class and boosted everyone's performance, sort of like how "herd immunity" can those who don't get vaccinated. But nobody suggested that, either; in fact, the consensus at the meeting was that it was important to get

*more*kids to attend. And we have.

To be fair, kids love the program, and for one group of our students, we've made it extremely helpful: kids who haven't finished a full year of Algebra I can do so and start in Geometry--an option we created before Freshman Connection, but incorporated into the program when it began. Nobody would say that Freshman Connection hurts anyone, and everyone who attends is glad they did. But I'm still skeptical that it actually improves academic or even socio-emotional outcomes for our students.

I'd say that too often in education we make decisions like the way we made these: without gathering data, or in the face of data that contradict our intuitions and preconceptions. The worst is when we teach based on what worked for us as individuals. Teachers lecture for 45 minutes with a little guided practice, then assign 1-47 odds for homework, despite mountains of research about what kinds of tasks, in what quantities, make for effective independent work. In many cases, teachers have heard of this research or been told about it, but at some level they don't believe it: lecture + practice + 1-47 odds worked for them when they were kids. Doing "what worked for me" is particularly harmful in math, where we tend to forget that those of us who are comfortable with math now are really "math survivors". Imagine if we taught kids to swim by dropping 100 kids at a time into a shark-infested pool; the two or three who made it out would later replicate that method, saying "it worked for me".

Even when the practices are not demonstrably harmful, using "what worked for me" or "what makes sense" as a metric ignores the fact that today's kids are growing up in environments that visibly and palpably different from the ones we grew up in. Recently, I posted this article (on Facebook) about how schools in Indiana will be giving up cursive instruction (yay!) but teaching keyboarding instead; I asked why bother teaching keyboarding either. An astonishing number of my friends commented that typing class had been incredibly useful for them, and how would kids learn to type well otherwise? My response: yes, but that was when typing was a specialized activity that you only did when preparing final drafts of papers; kids today type all the time and get immediate feedback about the quality of their typing; my students have learned to text blind quickly and accurately, without any formal instruction. And ... my friends repeated their arguments: it's important to learn to type quickly and accurately, and they only learned to type quickly and accurately in typing class.

I'm not saying that we should totally jettison personal experience and common sense when we teach. I'm just saying that we forget that both of those are anecdotal, and what memory and common sense tell us about our own experiences is not necessarily relevant to the population-at-large 30 years later. It took me a little over a year of teaching to realize that, although math homework was mostly irrelevant to my own learning of high school mathematics, it could really help my students--so I shouldn't make it optional. And it's that kind of skepticism, and openness to data, that we all could adopt more often.

## Sunday, July 3, 2011

### What do we want students to do?

Find all values of w such that...

Draw the graph of a function with the following properties ...

At what time will ...

If P, Q, R, and S are points on quadrilateral ABCD such that ... prove that ...

Find a polynomial with the following properties, or prove that no such polynomial exists.

As I was thinking about assessing mathematical knowledge, I began to wonder why virtually all test and quiz questions are of these types. It's not that hard to dream up different types of prompts. For example:Compute the probability that ...

Write an explanation of how to determine the degree of a polynomial based on its graph, including any uncertainty in the final answer.

Place isosceles trapezoids in the quadrilateral hierarchy drawn below, and explain your choice.

Explain the following statement: Given enough trials, any event with probability greater than 0, no matter how small, eventually occurs.

An ironing board has two legs of fixed length, one of which is free to slide along the length of the board, but both legs are attached at their midpoints as shown in the diagram below. Explain why this setup guarantees that the board is parallel to the floor.

All of these prompts demand a fair amount of mathematical knowledge, and the ability to construct coherent arguments. And--unlike most traditional math prompts--they get at skills and concepts in a way that might actually be useful to someone not involved in mathematics at a professional level. But -- okay, I'm contradicting myself slightly here -- coming up with these prompts is not trivial: it takes creativity, insight into what students will be able to do, time on the exam for students to work on them (so, not the 29th question on a 30-question hour exam), and time for thoughtful grading and assessment. Yet they are worthwhile: the last question is part of the best test I ever gave, the final exam for a two-week calculus course I taught for elementary school teachers (as part of the SESAME program at the University of Chicago), and what made it great was that it simultaneously allowedWhat is the derivative of a function? What is its importance and how is it computed? What information about a function can you get by examining values of its derivative? Explain using symbolic, numeric, and graphical examples, and including one example of motion.

__every__participant to demonstrate at least some knowledge, while

__differentiating__between teachers who knew a lot and teachers who knew only a little.

So here's the question. Why we almost-entirely-confine ourselves to the first kind of "problem"? Is it because

- We think that the most important thing for students to do is to work out these kinds of questions, or
- We want students to do other kinds of reasoning, but we don't know how to assess it, or
- [my sinking gut feeling] We haven't really thought carefully about what we might want students to be able to do
__besides__"solve problems," or whether this is the only (or even most important) set of skills and outcomes for students?