Exercises: The Data Engineering Career
Most of these are about you, and several will be uncomfortable. Exercises marked ๐งช use
code/career_map.py.
Do Exercise 40.1 today, not when you finish the chapter. It is the only one with a deadline set by your own memory.
Start Now
Exercise 40.1 โ Start the running document
Difficulty: โ โโ ยท Time: 5 minutes, then 90 seconds a week
ยง40.3 and ยง40.13's ๐.
- Create the file. Anywhere. Two columns: date, and what happened.
- Write three entries from the last month โ a design you improved, a question that changed something, a thing you talked someone out of. You will find this harder than you expect, which is the point.
- Set a rule: anything that makes you think "that was useful" goes in within the hour, without judging whether it counts.
- In two weeks, count the entries. How many would you have remembered without it?
Exercise 40.2 โ The ten-second test
Difficulty: โ โโ ยท Time: 20 minutes
ยง40.11: "if this product disappeared tomorrow, what would I still know?"
- List your five deepest technical skills.
- Apply the test to each. Write down what survives โ specifically, not "the fundamentals."
- Which of the five has the highest product content? Case Study 1's engineer was 30% product, 70% properties. What is your ratio?
- ยง40.11 says the gap โ knowing things you cannot articulate outside their product context โ is the whole vulnerability. Find one of yours and name it.
Exercise 40.3 โ Which question are you asking?
Difficulty: โ โโ ยท Time: 15 minutes
Case Study 1's finding: two people, the same four years, different outcomes, decided by which question they were asking.
- Recall your last three debugging sessions. Were you asking "how does this tool behave?" or "why is this slow / wrong?"
- Be honest about the ratio.
- ยง"Read the Plan" says you will not find out which you chose for several years. What earlier signal could you use?
Levels and Scope
Exercise 40.4 โ Place yourself
Difficulty: โ โ โ ยท Time: 30 minutes ยท ๐งช
python code/career_map.py --levels
- Which question are you currently trusted to answer? Not which you can answer โ which you are trusted to.
- Read the "judged on" column. What were you actually judged on in your last review?
- ยง40.3's four kinds of senior evidence: how many do you have from the last year?
- A thing you did not build, with a written reason โ do you have one? It is called the strongest artifact and almost nobody has one.
Exercise 40.5 โ Ask for an instance
Difficulty: โ โ โ ยท Time: one meeting
Case Study 2's four-minute question.
- Ask your manager: "Can you show me something a person did that got them promoted here? Not the criteria โ an actual thing somebody did."
- Get three examples if you can.
- What shape do they share? Case Study 2's were all about something not happening.
- Compare against your written criteria. How different are the two documents?
Exercise 40.6 โ Does the senior work exist?
Difficulty: โ โ โ ยท Time: one request
Case Study 2's ๐ญ test.
- Take the next request that arrives and ask what decision it serves.
- Was the question welcomed, tolerated, or treated as obstruction?
- Score your team against ยง"From the Pipeline"'s two columns.
- If you are in the second column: ยง40.3 says that is a reason to leave rather than to try harder. Do you agree? What would change your mind?
Specialization and Teams
Exercise 40.7 โ Score the tracks for yourself
Difficulty: โ โ โ ยท Time: 40 minutes ยท ๐งช
python code/career_map.py --tracks
- Rescore all five tracks with your own numbers, for your market and your preferences.
- Check that no track dominates after your changes. If one does, you have expressed a preference rather than a trade-off โ which is fine, but say so.
- ยง40.5 says pick the column you are least willing to compromise on. Which is it?
- Is your current track the one that column implies?
Exercise 40.8 โ Score your own team
Difficulty: โ โ โ ยท Time: 30 minutes ยท ๐งช
python code/career_map.py --health
- Score your team honestly. Twenty signals, range โ31 to +39.
- Which of the +4 and +5 signals do you have? Those are the ones that cannot be bought.
- ยง40.9 says good signals require sustained effort and bad ones are the resting state. Does your score support that?
- Pick the highest-weight signal you are missing and cost out getting it. For most teams that is the reconciliation.
Exercise 40.9 โ Score a team you are interviewing with
Difficulty: โ โ โ ยท Time: one interview
- Take the scoring sheet into a real conversation, using Chapter 39 ยง39.10's questions.
- Score during, not after.
- Set your decline threshold before the call. Chapter 39's Exercise 39.14 puts it plainly: a list with no decline rule is a list whose answers you rationalize.
- Compare your score against your gut feeling. Where did they disagree, and which was right?
Getting Better
Exercise 40.10 โ Audit your learning
Difficulty: โ โ โ ยท Time: 30 minutes
ยง40.10's compounding and non-compounding activities.
- List what you did to get better last year. Courses, reading, side projects, conference talks, on-call, postmortems, reviews.
- Classify each: attached to a system you were responsible for, or not.
- What fraction was attached? ยง40.10 argues only the attached kind compounds.
- ยง40.10's one-sentence version: ask to own something you are slightly not ready for, and make sure it pages you. What would that be, concretely, this quarter?
Exercise 40.11 โ Take the unwanted job
Difficulty: โ โ โ ยท Time: a quarter
Case Study 1's ๐ญ: "if your expertise is entirely upstream of meaning, take something downstream of it."
- Can you name a number your business makes a decision with? If not, that is the finding.
- Volunteer for the thing nobody wants โ the reconciliation, the metric definitions, the finance close, the data quality register.
- Do it for a quarter. Write down what you learn about the business that you did not know.
- Case Study 1's engineer says this was the actual lesson of a decade. Was it, for you?
Advanced
Exercise 40.12 โ Extend the map
Difficulty: โ โ โ ยท Time: 90 minutes ยท ๐งช
Add three to career_map.py, with self-checks:
- A sixth track for your market, scored โ and check that it does not dominate.
- A self-assessment mode that takes your answers to the twenty health signals and scores them.
- A level-evidence checklist from ยง40.3's four kinds, with a place to record instances.
- A skill-depreciation calculator: for each skill, a product fraction and a years-since estimate.
- A "questions I asked" tracker for Chapter 39 ยง39.10, so a job search accumulates comparable scores.
- A weighting sensitivity check: which single health signal most changes a team's verdict?
Then run #6. If one signal dominates, the twenty-signal list is that signal with decoration โ say whether that is a problem.
Exercise 40.13 โ Write your own version of ยง40.1
Difficulty: โ โ โ ยท Time: 45 minutes
ยง40.1 claims the job has changed shape three times and the core has not moved.
- Write the equivalent for your own career, in the same format: what the job was, in three or four eras.
- What has been constant? Be specific; "problem solving" does not count.
- If you cannot find a constant, that is worth knowing โ it may mean you have been changing jobs rather than deepening one.
- ยง40.1 says the constant is "somebody has to say what a number means and whether it is right." Do you agree that is the durable core of this field? Argue against it.
Exercise 40.14 โ The five-year letter
Difficulty: โ โ โ ยท Time: 60 minutes
Write a letter to yourself, to be read in five years.
- What you currently believe is durable in your skill set, and why.
- What you suspect is perishable, and what you are doing about it.
- The track you chose and the column you optimized for (ยง40.5).
- The team-health score of where you work now (ยง40.9), and what you decided about it.
- One prediction about the field that you are willing to be wrong about in writing.
Put a calendar reminder on it. Case Study 1's engineer spent a year believing four years were wasted; a letter from 2013 would have shortened that considerably, because it would have shown them what they were actually learning.
The Last One
Exercise 40.15 โ How do you know?
Difficulty: โ โ โ ยท Time: the rest of your career
ยง40.13.
- Pick the number your organization cares about most.
- Trace it to its source. Every rule, every transformation, every assumption.
- Ask, at each step: how do I know this is right? Not "does it look right."
- Write down every place the honest answer is "I don't."
- Fix one of them.
That list is the job. Everything in these forty chapters โ the partitioning, the idempotency, the assertions, the contracts, the reconciliation, the layer rules, the deletion manifest, the cost model โ exists to shorten it.
And the reason it matters is the only thing worth carrying out of this book: you are the reason a number on a screen means what someone thinks it means, and nearly nobody downstream is in a position to check.