tag:blogger.com,1999:blog-3916610575947257275.post8453652726594454995..comments2012-03-25T22:25:53.596-07:00Comments on CATCH-IT Blog: Health Informatics Journal Club: The unintended consequences of computerized provider order entry: findings from a mixed methods exploration.Gunther Eysenbach MD MPHhttp://www.blogger.com/profile/03418681005679727986noreply@blogger.comBlogger9125tag:blogger.com,1999:blog-3916610575947257275.post-44980834279732446292009-10-30T17:29:25.267-07:002009-10-30T17:29:25.267-07:00I am so confused by this paper. What research met...I am so confused by this paper. What research method and results are reported here? Why did it take four years? The taxonomy of nine major tpes of advers UCs, the national survey of unintended consequences, the survey of infusion questions, anticipation survey, are all reported in other papers. What happened to the interview with staff at 176 hospitals? Was the data analyzed by grounded theory? <br />The authors noted the difficulties they had to summarize the 4 year study. It was difficult to assess their conclusions based on what was provided in this paper.Claudiahttps://www.blogger.com/profile/17838814260478407987noreply@blogger.comtag:blogger.com,1999:blog-3916610575947257275.post-52372277455726765732009-10-30T14:11:43.775-07:002009-10-30T14:11:43.775-07:00Several sections keep referring the audience to ot...Several sections keep referring the audience to other papers published by the same research team while this particular research was being undertaken. I did not understand the rationale behind not including summaries of other UCs in this paper. <br />The authors have mentioned (Page S72) that a number of hospitals had policies against doing surveys. Would be interesting to know exactly what percentage of hospitals had this policy as this might impact the strength of their results. <br />The discussion on addressing the management of UC using mixed methods approach was very limited needs further explanation. Agree/Disagree?ShamsaJiwanihttps://www.blogger.com/profile/12199963244805850772noreply@blogger.comtag:blogger.com,1999:blog-3916610575947257275.post-55433242802284394622009-10-30T10:43:09.909-07:002009-10-30T10:43:09.909-07:00It is not clear in the article how the participati...It is not clear in the article how the participating organizations were chosen. Who decides the "excellence" of organizations? What criteria deems an organization as "excellent"? Furthermore, the authors mention that they were seeking sites with personnel who would be "willing" to describe their experiences and be observed during the order entry process. It is thus unclear to me whether the selected organizations were chosen based on the unclear "excellence" criteria, or on the basis of their sheer "willingness" to participate.Lambchopshttps://www.blogger.com/profile/11515542014489287324noreply@blogger.comtag:blogger.com,1999:blog-3916610575947257275.post-10482284089568322312009-10-30T08:47:59.613-07:002009-10-30T08:47:59.613-07:00 I am not too sure if the explanations regarding ... I am not too sure if the explanations regarding a mixed method approach, and research strategies both for the Grounded theory and survey approaches were sufficient and clear. <br /><br /> For instance, regarding the Grounded theory approach, the explanation provided was not sufficient in terms of identifying the key pints that led the authors to creating codes and from there to creating categories and concepts, and finally generating new theories from those categories. Their explanation was very superficial and incomplete. I believe the authors should have provided more clarification on these areas in the analysis and discussion sections of their paper. <br /><br /> Also, I believe as the others colleagues mentioned, the “juxtaposition error” that contributed to unintended consequences is more an issue of the usability and human factor issues, and flaw in system design, on which the authors did not comment. <br /><br /> Furthermore, the systems were mostly locally developed systems and authors did not comment on the possible effect of these variations of systems on the unintended consequences.Marjan Moeinedinhttps://www.blogger.com/profile/07709732766372054509noreply@blogger.comtag:blogger.com,1999:blog-3916610575947257275.post-33491117020164986262009-10-29T19:50:07.881-07:002009-10-29T19:50:07.881-07:00One big gap in the study is that they have selecte...One big gap in the study is that they have selected the organizations based on 'excellence' rather than their use of CPOEs with compatible features. I am not sure whether this is a blessing in disguise, because collecting the UCs of the use of different CPOEs with different features may just give them a wide range of UCs...which the authors categorize in this study. However, I would still like to question: "What strategies did the authors take to ensure ONE of the following: <br />(a) the CPOEs have similar features<br />OR <br />(b) the CPOEs have vastly different features.<br /><br />Now, on the flip side, it's important that we tie in the issues of human factors in this study, mainly because the authors have chosen to use different CPOEs which could have vastly different levels of human factors involved in their design. So, my next question would be, what are the possible consequences of using different organizations based on their use of different types of CPOEs in determining the type of UCs?<br /><br />What I'm pointing at is that there are numerous variables in this study. Had they kept the CPOE product fixed across all the organizations, perhaps the study result would have been a bit different?Talat Ashrafhttps://www.blogger.com/profile/12497365195542262697noreply@blogger.comtag:blogger.com,1999:blog-3916610575947257275.post-74066417337184450782009-10-29T11:12:43.392-07:002009-10-29T11:12:43.392-07:00I actually found this paper quite useful from a pr...I actually found this paper quite useful from a project- and change management point of view. However, some of the questions that came to my mind while reading were:<br /><br />-Did the UCs differ from hospitals using different CPOE systems? In other words, are the UCs systemic in nature, or a artifact of the specific system in question?<br /><br />-The authors mention on p. S73 the different informants of the UCs survey. How accurate or valid are the results of the survey? If only clinicians answered, the answers would differ greatly when compared to surveys answered by only informaticians.James Mullenhttps://www.blogger.com/profile/00305176966301991699noreply@blogger.comtag:blogger.com,1999:blog-3916610575947257275.post-89259679061453541352009-10-28T13:43:36.964-07:002009-10-28T13:43:36.964-07:00In addition to the comments above, I'm a littl...In addition to the comments above, I'm a little confused about this "anticipation survey" that they conducted. The authors already created their scheme of UCs, but then ask clinicians to confirm this? If so, I'm not sure if the q's listed in table 3 will address this issue and didn't they already interview clinicians regarding this earlier on in the study when they did their site visits? <br /><br />Not entirely sure about the validity of their sampling/interview method here either. (why only clinicians, why only community hospitals, why n=83)Cynhttps://www.blogger.com/profile/10857964469473952448noreply@blogger.comtag:blogger.com,1999:blog-3916610575947257275.post-26548972664892495992009-10-28T10:39:14.422-07:002009-10-28T10:39:14.422-07:00One of the challenges of appraising this paper on ...One of the challenges of appraising this paper on its own was that so many other papers had been published that likely provide further details. When arriving at the blog, I see that 2 more papers have been added as supplements to this one and may clear up some of the concerns.<br /><br />For now, here are some pieces that raised questions for me, <br />1. In the data analysis section, the authors describe developing a schema for analyzing transcripts then abandoning this, and declaring the use of grounded theory. Ignoring that qualitative researchers would consider this strategy unorthodox, using grounded theory as an analytical approach suggests there are no preconceived ideas/theories around the data - how were the authors able to not let the schema influence the analysis? <br /><br />2. How was 'reputation for excellence' assessed in choosing organizations?<br /><br />3. For Table 1: Is this a guideline or list of questions asked verbatim? If the questions were asked verbatim, could they have been constructed better? For instance, Question 1 has 3 questions collapsed into one. Asking each question independently would ensure answers are obtained for all questions.Laurehttps://www.blogger.com/profile/10487393394828253854noreply@blogger.comtag:blogger.com,1999:blog-3916610575947257275.post-56703359469242503072009-10-27T18:10:29.191-07:002009-10-27T18:10:29.191-07:00Interesting that this paper is an extension of pre...Interesting that this paper is an extension of previous studies as per the other papers you attached. I have not seen a great difference from the previous studies despite adding the mixed method approach. The questions or comments I would like to see addressed are:<br /><br /><br />1) Why did the questionnaire not address the usability and human factor issues around the use of CPOE that may have contributed to the unintended consequences?<br /><br />2) Change management (Process and Policy Changes) and implementation planning also affects the outcome of the CPOE. This is also not included in the questions. <br /><br />See response to a paper on the impact of CPOE on mortality rate for which Ash also responded.<br /><br />Ammenwerth E, Talmon J, Ash JS, Bates DW, Beuscart-Zephir MC, Duhamel A, Elkin PL, Gardner RM, Geissbuhler A. Impact of CPOE on mortality rates--contradictory findings, important messages. Methods Inf Med. 2006; 45(6):586-93.<br />http://iig.umit.at/dokumente/z42.pdfPlumaletta Berryhttps://www.blogger.com/profile/13332705347758344508noreply@blogger.com