sequence_number=34347,remote_client=AuthServer-BM,2009-01-30 13:49:18:637 GMT,messageID=-2,internal_error,description='Unable to send data to receiver.',details='java.io.IOException: Unable to send data to receiver.
Large number of groups ~ 32 thousand select count(*) from groups 31912 select count(*) from group_subgroup 36536 select count(*) from user_group 16691 select count(*) from explicit_entitlement 11152 11k entitlements. There are ~12 groups that are members(sub groups) of thousands of groups. It is one of these subgroupds that is experiencing the problem.
The query causing the problem, searched 134 gig of data on a machine with 20 meg of database
SELECT G.ID AS ID, G.ADMIN_GROUP_ID, G.NAME, G.DESCRIPTION, G.PUBLIC_STATE, G.CREATION_DATE, GP.PROPERTY_DEF_ID, GP.BOOLEAN_VALUE, GP.DATE_VALUE, GP.FLOAT_VALUE, GP.INT_VALUE, GP.STRING_VALUE FROM GROUPS G, GROUP_PROPERTY GP, GROUP_SUBGROUP GS WHERE (G.ID = GS.PARENT_GROUP_ID) AND (G.ID=GP.GROUP_ID(+)) AND (GS.CHILD_GROUP_ID = 1223696) ORDER BY NAME
1223696 is an internal support group who is a subgroup of 2700 thousand groups
A bad GROUP SUBGROUP relation was causing the problem. A 3rd level was added erroneously which was causing full-table scans and queries timing out.
With this many groups, keep nesting levels at two levels deep.