group_id	message_id	message_type	origin	original_text	clean_text	annotation_type	annotation_target	annotation_additional	team_performance	performance_change	sol_tracker_message	sol_tracker_all
457f8f61-fe07-4fce-a6cd-4b2875b3e069	-1	INITIAL	SYSTEM	Puffin,Panda,SYSTEM,Bat,Falcon&&G,6,A,3					0.562	0.0		{"Puffin": ["A"], "Bat": ["G", "3"], "Falcon": ["6", "A"], "Panda": ["6", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	a63a64f8-bf6a-45bc-9dee-e153deb24345	MESSAGE	Bat	This is the right answer	This is the right answer	None	0	0	0.562	0.0		{"Puffin": ["A"], "Bat": ["G", "3"], "Falcon": ["6", "A"], "Panda": ["6", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	34d8ad43-743e-4c93-af40-011bc9fcb51b	MESSAGE	Puffin	hi from NC!	hi from NC !	None	0	0	0.562	0.0		{"Puffin": ["A"], "Bat": ["G", "3"], "Falcon": ["6", "A"], "Panda": ["6", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	d98c4561-b227-43df-bba0-6998117e340f	MESSAGE	Bat	Need to flip "G" and "3"	Need to flip " <CARD> " and " <CARD> "	Non-probing-deliberation	Solution	complete_solution	0.562	0.0	G,3	{"Puffin": ["A"], "Bat": ["G", "3"], "Falcon": ["6", "A"], "Panda": ["6", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	c165bbeb-86f3-41b9-89d8-6577d2c17637	MESSAGE	Puffin	Yes A is the right answer	Yes <CARD> is the right answer	Non-probing-deliberation	Solution	complete_solution	0.562	0.0	A	{"Puffin": ["A"], "Bat": ["G", "3"], "Falcon": ["6", "A"], "Panda": ["6", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	e2a0ca98-3053-4c62-a7cc-bb5e91c16054	MESSAGE	Panda	'I don''t think we need to because it doesn''t explicitly say that G can''t have an even number.'	'I don''t think we need to because it doesn''t explicitly say that <CARD> can''t have an even number .'	Non-probing-deliberation	Reasoning	0	0.5	-0.062	G	{"Puffin": ["A"], "Bat": ["G", "3"], "Falcon": ["6", "A"], "Panda": ["G"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	1f76212c-75ce-4de6-ad41-2ae52168a2c1	MESSAGE	Falcon	To verify the rule, we have to check A and 6.	To verify the rule , we have to check <CARD> and <CARD> .	Non-probing-deliberation	Solution	complete_solution	0.5	0.0	6,A	{"Puffin": ["A"], "Bat": ["G", "3"], "Falcon": ["6", "A"], "Panda": ["G"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	24046e29-9ff1-4c11-b701-542674ffba3a	MESSAGE	Falcon	actually, my bad. Just A.	actually , my bad . Just <CARD> .	Non-probing-deliberation	Solution	complete_solution	0.562	0.062	A	{"Puffin": ["A"], "Bat": ["G", "3"], "Falcon": ["A"], "Panda": ["G"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	c8ab0771-b30f-42bb-95db-c31c147e163f	SUBMIT	Panda	3,A,6					0.688	0.126		{"Puffin": ["A"], "Bat": ["G", "3"], "Falcon": ["A"], "Panda": ["3", "A", "6"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	ff9bcb3b-79f3-493b-a9f8-f2025f20a516	MESSAGE	Puffin	agree with The Falcon Hunter	agree with The <MENTION> Hunter	Non-probing-deliberation	Agree	0	0.688	0.0		{"Puffin": ["A"], "Bat": ["G", "3"], "Falcon": ["A"], "Panda": ["3", "A", "6"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	e4c5372f-c57e-4a42-8e25-a3f57e7ae7cf	MESSAGE	Bat	Ok, turn "A" and "6"	Ok , turn " <CARD> " and " <CARD> "	Non-probing-deliberation	Solution	complete_solution	0.688	0.0	6,A	{"Puffin": ["A"], "Bat": ["6", "A"], "Falcon": ["A"], "Panda": ["3", "A", "6"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	e103d49f-f23b-4e0b-8050-2ebe7ed9033a	SUBMIT	Bat	6,A					0.688	0.0		{"Puffin": ["A"], "Bat": ["6", "A"], "Falcon": ["A"], "Panda": ["3", "A", "6"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	330174df-29fc-491d-9ed2-06f17d73e840	MESSAGE	Falcon	Just A, I think actually. The rule pertains to vowels only.	Just <CARD> , I think actually . The rule pertains to vowels only .	Non-probing-deliberation	Reasoning	complete_solution	0.688	0.0	A	{"Puffin": ["A"], "Bat": ["6", "A"], "Falcon": ["A"], "Panda": ["3", "A", "6"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	c4409bd6-c5c0-4ae0-ade9-1944263323f6	SUBMIT	Falcon	A					0.688	0.0		{"Puffin": ["A"], "Bat": ["6", "A"], "Falcon": ["A"], "Panda": ["3", "A", "6"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	a4d4b591-017a-4561-abce-23fa765aba5b	MESSAGE	Panda	Well if 3 has a vowel on the other side then then it changes the rule	Well if <CARD> has <CARD> vowel on the other side then then it changes the rule	Non-probing-deliberation	Reasoning	0	0.75	0.062	3,A	{"Puffin": ["A"], "Bat": ["6", "A"], "Falcon": ["A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	7803d90f-3c80-42b0-89a1-8cf3fdf4bf2d	MESSAGE	Falcon	Good point Panda	Good point <MENTION>	Non-probing-deliberation	Agree	0	0.75	0.0		{"Puffin": ["A"], "Bat": ["6", "A"], "Falcon": ["A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	dc349818-7916-4e6f-baff-015438a97ac6	SUBMIT	Falcon	3,A					0.812	0.062		{"Puffin": ["A"], "Bat": ["6", "A"], "Falcon": ["3", "A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	ae936851-f768-4d50-8965-73d00979fb10	MESSAGE	Puffin	same with G	same with <CARD>	Non-probing-deliberation	Reasoning	0	0.688	-0.124	G	{"Puffin": ["G"], "Bat": ["6", "A"], "Falcon": ["3", "A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	e9cd9a20-cd03-48b7-b887-5cb348437182	MESSAGE	Panda	'Yes, but the rule doesn''t say G can''t be even though'	'Yes , but the rule doesn''t say <CARD> can''t be even though'	Non-probing-deliberation	Reasoning	0	0.5	-0.188	G	{"Puffin": ["G"], "Bat": ["6", "A"], "Falcon": ["3", "A"], "Panda": ["G"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	e86629cd-0cfe-46ee-a290-4899e3b81cc6	MESSAGE	Falcon	'G wouldn''t matter, I don''t think.'	'<CARD> wouldn''t matter , I don''t think .'	Non-probing-deliberation	Reasoning	0	0.312	-0.188	G	{"Puffin": ["G"], "Bat": ["6", "A"], "Falcon": ["G"], "Panda": ["G"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	a3c8f4b3-f5e8-4d9a-8f41-44aa5c0d55cd	MESSAGE	Panda	'It is only saying that''s the case about vowels'	'It is only saying that''s the case about vowels'	Non-probing-deliberation	Reasoning	0	0.312	0.0		{"Puffin": ["G"], "Bat": ["6", "A"], "Falcon": ["G"], "Panda": ["G"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	6a0d6530-1041-419b-91ff-7a5874c86dfc	MESSAGE	Panda	'it never says G can''t be even'	'it never says <CARD> can''t be even'	Non-probing-deliberation	Reasoning	0	0.312	0.0	G	{"Puffin": ["G"], "Bat": ["6", "A"], "Falcon": ["G"], "Panda": ["G"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	4b41bcf6-c8ca-4ec3-9a77-cba892f20885	MESSAGE	Falcon	Exactly, Panda	Exactly , <MENTION>	Non-probing-deliberation	Agree	specific_addressee	0.312	0.0		{"Puffin": ["G"], "Bat": ["6", "A"], "Falcon": ["G"], "Panda": ["G"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	5760a185-a3df-4f43-9b98-fdb00c5ebfe5	MESSAGE	Bat	I think we have to flip all cards, right?	I think we have to flip all cards , right ?	Non-probing-deliberation	Solution	complete_solution	0.312	0.0	G,6,A,3	{"Puffin": ["G"], "Bat": ["G", "6", "A", "3"], "Falcon": ["G"], "Panda": ["G"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	60618916-1bba-4d04-8d85-0c3f15a31931	MESSAGE	Falcon	'I think it''s A and 3'	'I think it''s <CARD> and <CARD>'	Non-probing-deliberation	Solution	complete_solution	0.5	0.188	3,A	{"Puffin": ["G"], "Bat": ["G", "6", "A", "3"], "Falcon": ["3", "A"], "Panda": ["G"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	5384a3a7-949d-4d8c-b533-b90fb646a913	MESSAGE	Panda	'We have to flip 3 because it could be a vowel and we need to verify it isn''t to ensure the rule is correct'	'We have to flip <CARD> because it could be <CARD> vowel and we need to verify it isn''t to ensure the rule is correct'	Non-probing-deliberation	Reasoning	partial_solution	0.688	0.188	3,A	{"Puffin": ["G"], "Bat": ["G", "6", "A", "3"], "Falcon": ["3", "A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	27bc29e7-550b-4e49-83f5-1b442d00ab2a	MESSAGE	Bat	If card "G" has an "E or I" then the rule is wrong, right?	If card " <CARD> " has an " E or I " then the rule is wrong , right ?	Non-probing-deliberation	Reasoning	0	0.625	-0.063	G	{"Puffin": ["G"], "Bat": ["G"], "Falcon": ["3", "A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	c6dfeb67-ce7f-4d23-893d-52b379672a72	MESSAGE	Falcon	Good point Panda	Good point <MENTION>	Non-probing-deliberation	Agree	specific_addressee	0.625	0.0		{"Puffin": ["G"], "Bat": ["G"], "Falcon": ["3", "A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	a887b14f-08c0-422f-a1b3-41d5f69641e6	MESSAGE	Panda	'To that same end, we need to flip A because it is a vowel. As far as 6 we don''t need to flip it now that I think about it'	'To that same end , we need to flip <CARD> because it is <CARD> vowel . As far as <CARD> we don''t need to flip it now that I think about it'	Non-probing-deliberation	Reasoning	partial_solution	0.5	-0.125	6,A	{"Puffin": ["G"], "Bat": ["G"], "Falcon": ["3", "A"], "Panda": ["6", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	7e000a91-ce2e-4201-8923-e95e824a11ce	MESSAGE	Bat	So "G" 3 A	So " <CARD> " <CARD> <CARD>	Non-probing-deliberation	Solution	solution_summary	0.625	0.125	G,A,3	{"Puffin": ["G"], "Bat": ["G", "A", "3"], "Falcon": ["3", "A"], "Panda": ["6", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	6b30dc28-b1b9-4434-9ea5-d4e88de8fcd0	MESSAGE	Panda	'Because its saying that vowels have even numbers, but it doesn''t say none vowels don''t'	'Because its saying that vowels have even numbers , but it doesn''t say none vowels don''t'	Non-probing-deliberation	Reasoning	0	0.625	0.0		{"Puffin": ["G"], "Bat": ["G", "A", "3"], "Falcon": ["3", "A"], "Panda": ["6", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	d7f3e89a-a342-4901-b2fa-c7772b639d4b	MESSAGE	Bat	'I don''t think 6 either.'	'I don''t think <CARD> either .'	Non-probing-deliberation	Agree	0	0.5	-0.125	6	{"Puffin": ["G"], "Bat": ["6"], "Falcon": ["3", "A"], "Panda": ["6", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	b216f20f-6498-48bb-8065-ca16d07850c8	MESSAGE	Puffin	Just A, my vote	Just <CARD> , my vote	Non-probing-deliberation	Solution	complete_solution	0.625	0.125	A	{"Puffin": ["A"], "Bat": ["6"], "Falcon": ["3", "A"], "Panda": ["6", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	60f6b445-1cc7-4b79-8a99-c0b4894307f6	MESSAGE	Falcon	'right, because 6 could have a consonant behind it and that''s fine.'	'right , because <CARD> could have <CARD> consonant behind it and that''s fine .'	Non-probing-deliberation	Reasoning	0	0.5	-0.125	A,6	{"Puffin": ["A"], "Bat": ["6"], "Falcon": ["A", "6"], "Panda": ["6", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	dd00e9a1-0fbb-4f8b-8a63-42d4061ebab7	MESSAGE	Panda	'So flipping 6 doesn''t matter'	'So flipping <CARD> doesn''t matter'	Non-probing-deliberation	Reasoning	0	0.438	-0.062	6	{"Puffin": ["A"], "Bat": ["6"], "Falcon": ["A", "6"], "Panda": ["6"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	f3481d43-bc67-415f-9b1c-6aadcaa4b477	MESSAGE	Puffin	right	right	Non-probing-deliberation	Agree	0	0.438	0.0		{"Puffin": ["A"], "Bat": ["6"], "Falcon": ["A", "6"], "Panda": ["6"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	4d6d14d5-0f05-4cf1-a551-b2f93a09a3fd	MESSAGE	Bat	A could have a 3 behind it	<CARD> could have <CARD> <CARD> behind it	Non-probing-deliberation	Reasoning	0	0.625	0.187	3,A	{"Puffin": ["A"], "Bat": ["3", "A"], "Falcon": ["A", "6"], "Panda": ["6"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	aadb53a3-9f87-4b4a-aebe-7b9970e280c4	MESSAGE	Falcon	I still say A and 3.	I still say <CARD> and <CARD> .	Non-probing-deliberation	Solution	complete_solution	0.75	0.125	3,A	{"Puffin": ["A"], "Bat": ["3", "A"], "Falcon": ["3", "A"], "Panda": ["6"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	fa140990-fd05-479b-8ba8-2abb1fc9c9c4	MESSAGE	Bat	3 could have an I	<CARD> could have an I	Non-probing-deliberation	Reasoning	0	0.688	-0.062	3	{"Puffin": ["A"], "Bat": ["3"], "Falcon": ["3", "A"], "Panda": ["6"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	b1866f9e-8d93-4ba5-b79b-88321c4a9f59	MESSAGE	Panda	I would say 3 and A	I would say <CARD> and <CARD>	Non-probing-deliberation	Solution	complete_solution	0.875	0.187	3,A	{"Puffin": ["A"], "Bat": ["3"], "Falcon": ["3", "A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	e7de07b9-f4e7-4a07-9600-9cf7bf547ead	MESSAGE	Panda	because if 3 has a vowel	because if <CARD> has <CARD> vowel	Non-probing-deliberation	Reasoning	0	0.875	0.0	3,A	{"Puffin": ["A"], "Bat": ["3"], "Falcon": ["3", "A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	505ea0ee-9950-4a83-b40c-bfbdb026513b	MESSAGE	Bat	And if G has a vowel behind it, then rule is broken.	And if <CARD> has <CARD> vowel behind it , then rule is broken .	Non-probing-deliberation	Reasoning	0	0.812	-0.063	G,A	{"Puffin": ["A"], "Bat": ["G", "A"], "Falcon": ["3", "A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	7edcbaa6-b223-44bd-8eff-603b77c80116	MESSAGE	Panda	we know the rule is wrong	we know the rule is wrong	Non-probing-deliberation	Reasoning	0	0.812	0.0		{"Puffin": ["A"], "Bat": ["G", "A"], "Falcon": ["3", "A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	210f5ce1-eb9e-4cdb-b465-998ae292709b	MESSAGE	Panda	so we have to flip 3 to verify the rule	so we have to flip <CARD> to verify the rule	Non-probing-deliberation	Reasoning	partial_solution	0.75	-0.062	3	{"Puffin": ["A"], "Bat": ["G", "A"], "Falcon": ["3", "A"], "Panda": ["3"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	05c3b1bc-f9af-4eb9-9d70-c596f3e052a3	SUBMIT	Falcon	3,A					0.75	0.0		{"Puffin": ["A"], "Bat": ["G", "A"], "Falcon": ["3", "A"], "Panda": ["3"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	6f847c05-12e3-4d85-af18-c8adbff9c40e	MESSAGE	Falcon	'I''m going with A and 3.'	'I''m going with <CARD> and <CARD> .'	Non-probing-deliberation	Solution	complete_solution	0.75	0.0	3,A	{"Puffin": ["A"], "Bat": ["G", "A"], "Falcon": ["3", "A"], "Panda": ["3"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	2745a380-3127-43c3-a408-8e86b44d5278	MESSAGE	Panda	I say 3 and A	I say <CARD> and <CARD>	Non-probing-deliberation	Solution	complete_solution	0.812	0.062	3,A	{"Puffin": ["A"], "Bat": ["G", "A"], "Falcon": ["3", "A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	1eaa2c16-38bd-48b2-a4b9-cb687c4a4d68	SUBMIT	Falcon	3,A					0.812	0.0		{"Puffin": ["A"], "Bat": ["G", "A"], "Falcon": ["3", "A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	8ce4beff-e03d-4793-92e4-fb8fe8ca6034	SUBMIT	Panda	3,A					0.812	0.0		{"Puffin": ["A"], "Bat": ["G", "A"], "Falcon": ["3", "A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	1bc1d748-465b-490e-9d36-a777fee69f5f	SUBMIT	Panda	3,A					0.812	0.0		{"Puffin": ["A"], "Bat": ["G", "A"], "Falcon": ["3", "A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	cbaf1326-4c00-4ccb-a29b-3f7e061e45d5	SUBMIT	Puffin	A					0.812	0.0		{"Puffin": ["A"], "Bat": ["G", "A"], "Falcon": ["3", "A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	1df750a7-6d05-4e78-a917-3fd27d03c96c	MESSAGE	Bat	Ok, A and 3	Ok , <CARD> and <CARD>	Non-probing-deliberation	Solution	complete_solution	0.938	0.126	3,A	{"Puffin": ["A"], "Bat": ["3", "A"], "Falcon": ["3", "A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	62bdbc23-da04-45c8-98b7-d6095a7f375b	SUBMIT	Puffin	A					0.938	0.0		{"Puffin": ["A"], "Bat": ["3", "A"], "Falcon": ["3", "A"], "Panda": ["3", "A"]}
457f8f61-fe07-4fce-a6cd-4b2875b3e069	0285d9df-2ac3-4fc9-bd03-e548d0682af6	SUBMIT	Bat	3,A					0.938	0.0		{"Puffin": ["A"], "Bat": ["3", "A"], "Falcon": ["3", "A"], "Panda": ["3", "A"]}
