SQUID съедает всю память

Сейчас он только растёт, могу дать mgr:info в пик, когда начинает есть swap

Squid Object Cache: Version 3.1.9

Start Time:	Tue, 25 Jan 2011 12:24:54 GMT
Current Time:	Wed, 26 Jan 2011 07:55:57 GMT

Connection information for squid:
	Number of clients accessing cache:	34
	Number of HTTP requests received:	168204
	Number of ICP messages received:	0
	Number of ICP messages sent:	0
	Number of queued ICP replies:	0
	Number of HTCP messages received:	0
	Number of HTCP messages sent:	0
	Request failure ratio:	 0.00
	Average HTTP requests per minute since start:	143.6
	Average ICP messages per minute since start:	0.0
	Select loop called: 120875923 times, 0.581 ms avg
Cache information for squid:
	Hits as % of all requests:	5min: 19.5%, 60min: 19.1%
	Hits as % of bytes sent:	5min: 8.4%, 60min: 10.2%
	Memory hits as % of hit requests:	5min: 2.6%, 60min: 6.9%
	Disk hits as % of hit requests:	5min: 5.3%, 60min: 18.6%
	Storage Swap size:	943368 KB
	Storage Swap capacity:	90.0% used, 10.0% free
	Storage Mem size:	64888 KB
	Storage Mem capacity:	100.0% used,  0.0% free
	Mean Object Size:	16.85 KB
	Requests given to unlinkd:	34544
Median Service Times (seconds)  5 min    60 min:
	HTTP Requests (All):   0.01387  0.00379
	Cache Misses:          0.10857  0.10281
	Cache Hits:            0.01556  0.00091
	Near Hits:             0.05046  0.05331
	Not-Modified Replies:  0.00091  0.00091
	DNS Lookups:           0.00094  0.00190
	ICP Queries:           0.00000  0.00000
Resource usage for squid:
	UP Time:	70263.625 seconds
	CPU Time:	362.844 seconds
	CPU Usage:	0.52%
	CPU Usage, 5 minute avg:	1.47%
	CPU Usage, 60 minute avg:	1.73%
	Process Data Segment Size via sbrk(): 498404 KB
	Maximum Resident Size: 2010096 KB
	Page faults with physical i/o: 1
Memory usage for squid via mallinfo():
	Total space in arena:  498536 KB
	Ordinary blocks:       183523 KB  21787 blks
	Small blocks:               0 KB      0 blks
	Holding blocks:           632 KB      2 blks
	Free Small blocks:          0 KB
	Free Ordinary blocks:  315012 KB
	Total in use:          184155 KB 37%
	Total free:            315012 KB 63%
	Total size:            499168 KB
Memory accounted for:
	Total accounted:        84257 KB  17%
	memPool accounted:      84257 KB  17%
	memPool unaccounted:   414910 KB  83%
	memPoolAlloc calls:         2
	memPoolFree calls:   43142557
File descriptor usage for squid:
	Maximum number of file descriptors:   1024
	Largest file desc currently in use:    528
	Number of file desc currently in use:  263
	Files queued for open:                   0
	Available number of file descriptors:  761
	Reserved number of file descriptors:   100
	Store Disk files open:                   0
Internal Data Structures:
	 56014 StoreEntries
	  3359 StoreEntries with MemObjects
	  3356 Hot Object Cache Items
	 55982 on-disk objects

Текущий конфиг:

proxy ~ # grep -v "^#" /etc/squid/squid.conf | sed -e '/^$/d'
auth_param ntlm program /usr/bin/ntlm_auth --helper-protocol=squid-2.5-ntlmssp
auth_param ntlm children 90
auth_param basic program /usr/bin/ntlm_auth --helper-protocol=squid-2.5-basic
auth_param basic children 50
auth_param basic realm Squid proxy-caching web server
auth_param basic credentialsttl 2 hours
auth_param basic casesensitive off
acl manager proto cache_object
acl localhost src 127.0.0.1/32 192.92.92.100
acl to_localhost dst 127.0.0.0/8 0.0.0.0/32
acl localnet src 192.92.92.0/24
external_acl_type nt_group ttl=0 children=30 %LOGIN /usr/libexec/squid/wbinfo_group.pl
acl inet_full external nt_group inetfull
acl inet_none external nt_group inetnone
acl IRCOC proxy_auth REQUIRED
acl SSL_ports port 443 15100 3900
acl Jabber_ports port 5222 5223
acl Safe_ports port 80          # http
acl Safe_ports port 21          # ftp
acl Safe_ports port 443         # https
acl Safe_ports port 70          # gopher
acl Safe_ports port 210         # wais
acl Safe_ports port 1025-65535  # unregistered ports
acl Safe_ports port 280         # http-mgmt
acl Safe_ports port 488         # gss-http
acl Safe_ports port 591         # filemaker
acl Safe_ports port 777         # multiling http
acl Safe_ports port 901         # SWAT
acl CONNECT method CONNECT
http_access deny !Safe_ports
http_access deny CONNECT !SSL_ports !Jabber_ports
http_access allow manager localhost
acl media urlpath_regex -i \.mp3$ \.mp4$ \.asf$ \.wma$ \.wav$ \.avi$ \.mpeg$ \.mpg$ \.mov$ \.mkv$ \.flv$ \.iflv$ \.3gp$
acl otherfiles urlpath_regex -i \.exe$ \.rar$ \.zip$ \.doc$ \.7zp$ \.msi$ \.swf$ \.dat$
acl bannedurl url_regex -i .+vkontakte.+\.mp3
acl bannedurl url_regex 83.239.93.62
acl adobeupdate dstdom_regex update.adobe.com swupmf.adobe.com crl.adobe.com
acl windowsupdate dstdom_regex download.windowsupdate.com au.download.windowsupdate.com update.microsoft.com verisign.com
acl timesites_url url_regex -i "/etc/squid/acls/timesites_url.acl"
acl timesites_domain dstdom_regex -i "/etc/squid/acls/timesites_domain.acl"
acl banners url_regex -i "/etc/squid/acls/banners.acl"
acl kaspersky dstdom_regex geo.kaspersky.com
acl winactivate dstdom_regex activation.sls.microsoft.com
http_access allow all kaspersky
http_access allow all winactivate
acl DownloadTime time 10:00-18:00
http_access allow all DownloadTime windowsupdate
http_access deny !inet_full DownloadTime media
http_access deny !inet_full DownloadTime timesites_url
http_access deny !inet_full DownloadTime timesites_domain
http_access deny !inet_full DownloadTime bannedurl
http_access deny all adobeupdate
http_access deny all banners
deny_info http://192.92.92.100/images/empty.gif banners
http_access allow localhost
http_access deny inet_none
http_access allow IRCOC
http_access deny all
delay_pools 1
delay_class 1 1
delay_parameters 1 300000/300000
delay_access 1 allow !inet_full !localhost
delay_access 1 deny all
http_access allow localhost
http_access deny all
http_port 192.92.92.100:3128
hierarchy_stoplist cgi-bin ?
cache_mem 64 MB
cache_dir ufs /mnt/cache/squid1g 1024 16 256
maximum_object_size 10240 KB
coredump_dir /var/cache/squid
refresh_pattern ^ftp:           1440    20%     10080
refresh_pattern ^gopher:        1440    0%      1440
refresh_pattern -i (/cgi-bin/|\?) 0     0%      0
refresh_pattern .               0       20%     4320
ignore_expect_100 on
cache_mgr 
memory_pools off

Итого:
Number of clients accessing cache: 34
cache_mem 64 MB
memory_pools off
cache_dir ufs /mnt/cache/squid1g 1024 16 256

И куда ему столько памяти......:
Process Data Segment Size via sbrk(): 498404 KB

Вот это очень интересно:
Memory accounted for:
Total accounted: 84257 KB 17%
memPool accounted: 84257 KB 17%
memPool unaccounted: 414910 KB 83% !!!!!!!!!!!!!!!!!!!!!!!!!!

Вот вобще жара: Process Data Segment Size via sbrk(): 2770756 KB

Squid Object Cache: Version 3.1.9

Start Time:	Thu, 27 Jan 2011 09:25:09 GMT
Current Time:	Thu, 27 Jan 2011 12:16:10 GMT

Connection information for squid:
	Number of clients accessing cache:	31
	Number of HTTP requests received:	84132
	Number of ICP messages received:	0
	Number of ICP messages sent:	0
	Number of queued ICP replies:	0
	Number of HTCP messages received:	0
	Number of HTCP messages sent:	0
	Request failure ratio:	 0.00
	Average HTTP requests per minute since start:	491.9
	Average ICP messages per minute since start:	0.0
	Select loop called: 95820323 times, 0.107 ms avg
Cache information for squid:
	Hits as % of all requests:	5min: 13.5%, 60min: 12.1%
	Hits as % of bytes sent:	5min: 17.5%, 60min: 11.8%
	Memory hits as % of hit requests:	5min: 25.4%, 60min: 6.8%
	Disk hits as % of hit requests:	5min: 43.2%, 60min: 22.3%
	Storage Swap size:	943776 KB
	Storage Swap capacity:	90.0% used, 10.0% free
	Storage Mem size:	64840 KB
	Storage Mem capacity:	99.9% used,  0.1% free
	Mean Object Size:	16.95 KB
	Requests given to unlinkd:	15729
Median Service Times (seconds)  5 min    60 min:
	HTTP Requests (All):   0.02069  0.02899
	Cache Misses:          0.14252  0.13498
	Cache Hits:            0.00179  0.00179
	Near Hits:             0.09219  0.03829
	Not-Modified Replies:  0.00091  0.00091
	DNS Lookups:           0.00190  0.00573
	ICP Queries:           0.00000  0.00000
Resource usage for squid:
	UP Time:	10261.074 seconds
	CPU Time:	519.769 seconds
	CPU Usage:	5.07%
	CPU Usage, 5 minute avg:	2.06%
	CPU Usage, 60 minute avg:	9.45%
	Process Data Segment Size via sbrk(): 2770756 KB
	Maximum Resident Size: 11092848 KB
	Page faults with physical i/o: 3
Memory usage for squid via mallinfo():
	Total space in arena:  -1423416 KB
	Ordinary blocks:       152479 KB  55406 blks
	Small blocks:               0 KB      0 blks
	Holding blocks:           632 KB      2 blks
	Free Small blocks:          0 KB
	Free Ordinary blocks:  -1575896 KB
	Total in use:          153111 KB -10%
	Total free:            -1575896 KB 111%
	Total size:            -1422784 KB
Memory accounted for:
	Total accounted:        83890 KB  -5%
	memPool accounted:      83890 KB  -5%
	memPool unaccounted:   -1506675 KB   0%
	memPoolAlloc calls:         2
	memPoolFree calls:   75057057
File descriptor usage for squid:
	Maximum number of file descriptors:   1024
	Largest file desc currently in use:    355
	Number of file desc currently in use:  300
	Files queued for open:                   0
	Available number of file descriptors:  724
	Reserved number of file descriptors:   100
	Store Disk files open:                   0
Internal Data Structures:
	 55714 StoreEntries
	  4339 StoreEntries with MemObjects
	  4333 Hot Object Cache Items
	 55678 on-disk objects

К сожалению.... Да... Я не знаю с чем это связано. И на убунте и на Gentoo сквид 3.1.* сжирает память. НУ ПРОСТО НЕ МОГУ НЕ ОТМЕТИТЬ! В Gentoo сквид кушает сразу порциями в сотню метров, в убунту потихонечку по парочке мегабайт!!! Ну как так?!
А вот 2.7 stable 9 живёт отлично стабильно с (таким же конфигом как в 3.1.* естественно под формат точил) авторизациями, ACLями, бассейнами, кэшем на 20гб и вобще делай что хочешь в конфиге, всё нормально.
Я не смог выяснить причину. Бился полгода.

И, да. Какое нервосбережение - просыпаться утром не думая о том, что из всего богатого арсенала серверов, должна умереть прокся...
А я то наивный, то патчи юзал то снижался в ветке 3.1, то на другую ОС ставил...

Хочу от себя ещё вот что сказать, переполнение зависит от некоторых клиентов сквида, так как в отпуске сидело человек 20 и всё было хорошо, как кто то появляется, то 3.1.* начинает падать

RTFM!

Настройте макс. размер кэшируемых файлов и все!