Erik Johnston
							
						 
						
							 
							
							
							
								
							
								247c736b9b 
								
							
								 
							
						 
						
							
							
								
								Merge pull request  #2115  from matrix-org/erikj/dedupe_federation_repl  
							
							 
							
							... 
							
							
							
							Reduce federation replication traffic 
							
						 
						
							2017-04-12 11:07:13 +01:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								26ae5178a4 
								
							
								 
							
						 
						
							
							
								
								Add some comments  
							
							 
							
							
							
						 
						
							2017-04-12 10:36:29 +01:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								a8c8e4efd4 
								
							
								 
							
						 
						
							
							
								
								Comment  
							
							 
							
							
							
						 
						
							2017-04-11 15:35:49 +01:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								2be8a281d2 
								
							
								 
							
						 
						
							
							
								
								Comments  
							
							 
							
							
							
						 
						
							2017-04-11 15:28:24 +01:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								84fbb80c8f 
								
							
								 
							
						 
						
							
							
								
								Use generators  
							
							 
							
							
							
						 
						
							2017-04-10 16:55:56 +01:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								40453b3f84 
								
							
								 
							
						 
						
							
							
								
								Dedupe KeyedEdu and Devices federation repl traffic  
							
							 
							
							
							
						 
						
							2017-04-10 16:49:51 +01:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								29574fd5b3 
								
							
								 
							
						 
						
							
							
								
								Reduce federation presence replication traffic  
							
							 
							
							... 
							
							
							
							This is mainly done by moving the calculation of where to send presence
updates from the presence handler to the transaction queue, so we only
need to send the presence event (and not the destinations) across the
replication connection. Before we were duplicating by sending the full
state across once per destination. 
							
						 
						
							2017-04-10 16:48:30 +01:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								0018491af2 
								
							
								 
							
						 
						
							
							
								
								Rename variable  
							
							 
							
							
							
						 
						
							2017-04-10 12:44:43 +01:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								8c5f03cec7 
								
							
								 
							
						 
						
							
							
								
								Revert to sending the same data type as before  
							
							 
							
							
							
						 
						
							2017-04-10 10:07:18 +01:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								f8434db549 
								
							
								 
							
						 
						
							
							
								
								Change name  
							
							 
							
							
							
						 
						
							2017-04-10 10:03:07 +01:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								ab904caf33 
								
							
								 
							
						 
						
							
							
								
								Comments  
							
							 
							
							
							
						 
						
							2017-04-10 10:02:17 +01:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								a828a64b75 
								
							
								 
							
						 
						
							
							
								
								Comment  
							
							 
							
							
							
						 
						
							2017-04-07 11:54:03 +01:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								d4d176e5d0 
								
							
								 
							
						 
						
							
							
								
								Add logging  
							
							 
							
							
							
						 
						
							2017-04-07 11:51:28 +01:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								449d1297ca 
								
							
								 
							
						 
						
							
							
								
								Fix up federation SendQueue and document types  
							
							 
							
							
							
						 
						
							2017-04-07 11:48:33 +01:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								f10ce8944b 
								
							
								 
							
						 
						
							
							
								
								Don't double json encode federation replication data  
							
							 
							
							
							
						 
						
							2017-04-05 11:10:28 +01:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								11880103b1 
								
							
								 
							
						 
						
							
							
								
								Make federation send queue take the current position  
							
							 
							
							
							
						 
						
							2017-03-30 12:54:36 +01:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								35b4aa04be 
								
							
								 
							
						 
						
							
							
								
								Notify on new federation traffic  
							
							 
							
							
							
						 
						
							2017-03-27 14:07:47 +01:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								4c79a63fd7 
								
							
								 
							
						 
						
							
							
								
								Explicit federation ack  
							
							 
							
							
							
						 
						
							2016-11-23 10:40:44 +00:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								51e89709aa 
								
							
								 
							
						 
						
							
							
								
								Comments  
							
							 
							
							
							
						 
						
							2016-11-21 17:59:39 +00:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								88d85ebae1 
								
							
								 
							
						 
						
							
							
								
								Add some metrics  
							
							 
							
							
							
						 
						
							2016-11-21 17:36:05 +00:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								50934ce460 
								
							
								 
							
						 
						
							
							
								
								Comments  
							
							 
							
							
							
						 
						
							2016-11-21 16:55:23 +00:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								9687e039e7 
								
							
								 
							
						 
						
							
							
								
								Remove explicit calls to send_pdu  
							
							 
							
							
							
						 
						
							2016-11-21 14:48:51 +00:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								f8ee66250a 
								
							
								 
							
						 
						
							
							
								
								Handle sending events and device messages over federation  
							
							 
							
							
							
						 
						
							2016-11-17 15:48:04 +00:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								ed787cf09e 
								
							
								 
							
						 
						
							
							
								
								Hook up the send queue and create a federation sender worker  
							
							 
							
							
							
						 
						
							2016-11-16 17:34:44 +00:00  
						
					 
				
					
						
							
							
								 
								Erik Johnston
							
						 
						
							 
							
							
							
								
							
								1587b5a033 
								
							
								 
							
						 
						
							
							
								
								Add initial cut of federation send queue  
							
							 
							
							
							
						 
						
							2016-11-16 14:47:52 +00:00