Date Submitted: 10/24/2019
Question summary:
Changing assessments based on sponsor sensitivities?
Full question:
Response 1
Response 2
This is a very common situation. Stakeholders often ask for substantive changes to documents of this type. I have three thoughts. First, it's great that you wrote it as you see it - even knowing you may get pushback, always do that first! It opens conversations with a stakeholder that themselves are a form of responsible engagement. Second, I see it as absolutely appropriate to push back if a stakeholder is asking you a put a byline on something that does not reflect your accurate scholarly view of the situation. You may not be able to "demand" that they include those views, but you do have the power to resign from the assignment and control how your name is used. Ultimately knowing your bottom line and being willing to draw it can be useful here. But I would not necessarily advise jumping to that - know your bottom line and keep that in your back pocket and instead engage in a conversation about how to express the points you find important in a way they find palatable. Maybe figure out how they see their interests and see if there is a way to present the needed information in a way that you can both live with. But I absolutely agree with not caving to their demand that you drop it entirely. If nothing else, that conversation about why it needs to be in the report itself is an important form of responsible scholarly engagement with a stakeholder. And if the negotiation goes well, you may still be able to put your byline on the product. However I do believe it is very important to be prepared to walk away if there is undue censorship of important facts at work, and knowing what is the line you wouldn't be comfortable crossing is the first step. Don't feel discouraged by these conversations or feel that they aren't willing to negotiate - they likely will be. They are invested in your work, just as you are, and they will likely want to find a win-win. Good luck!
Response 3
How you respond depends, in part, on what the purpose of the assessment is. First, is this an internal/confidential assessment that will be provided to the Board or the Senior Management of the Bank, or is it something that will be made public? Second, the question does not make clear whether the regional development bank is paying you to do this assessment. Depending on your own normative commitments and whether this relationship with the Bank is one you hope to maintain, then these two conditions might have an impact on your response. More on this below.
But based on the information you have provided in this question, I know how I would respond. I would ask myself whether the information provided to me by the Bank (prospects for constructive engagement and the impact on economic investments) is something I did not already know and whether these factors, if included, might have an impact on my initial forecast of the macro trends. If the answer to these questions is "yes," then I would re-assess the evidence in light of this new evidence and judge whether these two new factors were likely to change the forecast. If the answer to these questions is "no," or if including them does not change my conclusions, then I would be firm about including my negative assessment. In fact, my response would include the methods/process I employed to make this decision and to reassess my initial forecasts in light of this new evidence. And I think this is the take home message for researchers who are engaged with practitioners -- we have adopted particular norms and procedures that guide our analysis of evidence in our scholarly work. We should employ these same methods as guides to action and as justifications for our decisions to partners and funders in the policy world. In the end, the reason we believe that our own analyses and assessments are qualitatively different (superior?) from those provided by practitioners or internal analysts is because we are more committed to transparent methods and because, if tenured at a university, we can afford to be. So, my answer would be: Include my assessment in the final report and feel free to attribute it to me alone, or else you can get someone else to do your "external" assessment.
Now let me return to those first two conditions that I started with. I recognize that my own answers comes from a position of privilege. My next paycheck is not dependent upon what I say in any given report and I value my reputation among my peers far more than a good working relationship with any regional development bank. That makes the decision easier. If you choose to modify your forecast and "walk back" some of your criticisms, then you likely need to convince yourself that your involvement in future assessments with/for this Bank are going to do more good than the next researcher they plug in to fill this role. I'd have a hard time convincing myself of this idea, but I could imagine someone else coming to this conclusion.