2018-05-20 - Re: [GRASE-Hotspot] how to cleanup old data and logs

Header Data

From: Timothy White <ti***8@gmail.com>
Message Hash: c8d077edf4e8f9110e65cab2be55dda27a7e61d92228126c10cbd30b6df14d4a
Message ID: <CAESLx0KCWQhrJnq=pvUejLWxSrgSGHt8_K4eQzUzKu=Tpga83g@mail.gmail.com>
Reply To: <1b4b886b-8541-4086-8aa4-01087eae1c98@grasehotspot.org>
UTC Datetime: 2018-05-20 12:42:19 UTC
Raw Date: Mon, 21 May 2018 05:42:19 +1000

Raw message 

The radpostauth table is the one that grows large. It was fixed in 3.7.7.8.
Is there any reason you haven't upgraded to a newer version?
You can see the difference between your current version and 3.7.7.8 at
https://github.com/GraseHotspot/grase-www-portal/compare/3.7.7.6...3.7.7.8

Ideally, if you can upgrade, that would help. Otherwise you'll need to
manually keep the radpostauth table under control. (Also, because it's
grown, truncating it won't free up disk space, but will improve
performance. The MySQL DB can't ever shrink, but it will stop growing).

Regards

Tim

On Mon, 21 May 2018 at 04:30, Gianluca Filippini <
gi***4@gmail.com> wrote:

> Hi Tim,
> thanks a lot for your reply.
>
> indeed this is an extremely old machine (behind an IPfire fw .. which
> instead is always updated).
> ok .. very old .. but still works just fine ..
> :-D
>
> turns out the database backup was 99% of the used space!
> now my hdisk utilization went from 65% to 6% !! hurray.
>
> btw: if there is some other table in mysql that I need to cleanup manually
> (or with a script) due to the old version of grase please let me know.
>
> below are the info on the machine (minus local details)
>
>
>
>
> Grase Support Information Script = 2016040401
> == Grase Package versions ==
> mysql-server:
>   Installed: 5.1.69-0ubuntu0.11.10.1
>   Candidate: 5.1.69-0ubuntu0.11.10.1
>   Version table:
>  *** 5.1.69-0ubuntu0.11.10.1 0
>         500 http://old-releases.ubuntu.com/ubuntu/ oneiric-updates/main
> amd64 Packages
>         500 http://old-releases.ubuntu.com/ubuntu/ oneiric-security/main
> amd64 Packages
>         100 /var/lib/dpkg/status
>      5.1.58-1ubuntu1 0
>         500 http://old-releases.ubuntu.com/ubuntu/ oneiric/main amd64
> Packages
> freeradius:
>   Installed: 2.1.10+dfsg-3ubuntu0.11.10.1
>   Candidate: 2.1.10+dfsg-3ubuntu0.11.10.1
>   Version table:
>  *** 2.1.10+dfsg-3ubuntu0.11.10.1 0
>         500 http://old-releases.ubuntu.com/ubuntu/ oneiric-updates/main
> amd64 Packages
>         500 http://old-releases.ubuntu.com/ubuntu/ oneiric-security/main
> amd64 Packages
>         100 /var/lib/dpkg/status
>      2.1.10+dfsg-3 0
>         500 http://old-releases.ubuntu.com/ubuntu/ oneiric/main amd64
> Packages
> squid3:
>   Installed: 3.1.14-1ubuntu0.3
>   Candidate: 3.1.14-1ubuntu0.3
>   Version table:
>  *** 3.1.14-1ubuntu0.3 0
>         500 http://old-releases.ubuntu.com/ubuntu/
> oneiric-updates/universe amd64 Packages
>         500 http://old-releases.ubuntu.com/ubuntu/
> oneiric-security/universe amd64 Packages
>         100 /var/lib/dpkg/status
>      3.1.14-1 0
>         500 http://old-releases.ubuntu.com/ubuntu/ oneiric/universe amd64
> Packages
> coova-chilli:
>   Installed: 1.2.9-grase3
>   Candidate: 1.3.0-22-g39df09b
>   Version table:
>      1.3.0-22-g39df09b 0
>         500 http://packages.grasehotspot.org/ purewhite/main amd64
> Packages
>  *** 1.2.9-grase3 0
>         100 /var/lib/dpkg/status
> grase-conf-squid3-3.1:
>   Installed: (none)
>   Candidate: 1.6.13.gc9496e0
>   Version table:
>      1.6.13.gc9496e0 0
>         500 http://packages.grasehotspot.org/ purewhite/main amd64
> Packages
> grase-conf-squid3-3.3:
>   Installed: (none)
>   Candidate: 1.6.13.gc9496e0
>   Version table:
>      1.6.13.gc9496e0 0
>         500 http://packages.grasehotspot.org/ purewhite/main amd64
> Packages
> grase-conf-dnsmasq:
>   Installed: 1.6
>   Candidate: 1.6
>   Version table:
>  *** 1.6 0
>         500 http://packages.grasehotspot.org/ purewhite/main amd64
> Packages
>         100 /var/lib/dpkg/status
> grase-conf-apache2:
>   Installed: 1.1
>   Candidate: 1.1.12.gabb2ede
>   Version table:
>      1.1.12.gabb2ede 0
>         500 http://packages.grasehotspot.org/ purewhite/main amd64
> Packages
>  *** 1.1 0
>         100 /var/lib/dpkg/status
> grase-www-portal:
>   Installed: 3.7.7.6
>   Candidate: 3.8.0
>   Version table:
>      3.8.0 0
>         500 http://packages.grasehotspot.org/ purewhite/main amd64
> Packages
>  *** 3.7.7.6 0
>         100 /var/lib/dpkg/status
> grase-conf-freeradius:
>   Installed: 1.9.4
>   Candidate: 1.9.4.16.g0d854c6
>   Version table:
>      1.9.4.16.g0d854c6 0
>         500 http://packages.grasehotspot.org/ purewhite/main amd64
> Packages
>  *** 1.9.4 0
>         100 /var/lib/dpkg/status
> grase-conf-nginx:
>   Installed: (none)
>   Candidate: 1.1
>   Version table:
>      1.1 0
>         500 http://packages.grasehotspot.org/ purewhite/main amd64
> Packages
> grase-conf-openvpn:
>   Installed: (none)
>   Candidate: 1.7.1
>   Version table:
>      1.7.1 0
>         500 http://packages.grasehotspot.org/ purewhite/main amd64
> Packages
> grase-conf-squid3:
>   Installed: 1.5
>   Candidate: 1.5
>   Version table:
>  *** 1.5 0
>         100 /var/lib/dpkg/status
> grase-remote-assist-user:
>   Installed: (none)
>   Candidate: 1.5
>   Version table:
>      1.5 0
>         500 http://packages.grasehotspot.org/ purewhite/main amd64
> Packages
> grase-repo:
>   Installed: 1.4
>   Candidate: 1.7
>   Version table:
>      1.7 0
>         500 http://packages.grasehotspot.org/ purewhite/main amd64
> Packages
>  *** 1.4 0
>         100 /var/lib/dpkg/status
> grase-www-portal-ext-libs:
>   Installed: (none)
>   Candidate: 3.8.0
>   Version table:
>      3.8.0 0
>         500 http://packages.grasehotspot.org/ purewhite/main amd64
> Packages
> == Grase Repository Details ==
> deb http://packages.grasehotspot.org/ purewhite main
> == Grase DNS Details ==
> #### This file is auto generated                              ####
> #### Please do not edit it.                                   ####
> #### Changes can be made in the Grase Hotspot Admin interface ####
> #chilli_lanip 10.1.0.1
> #chilli_wanif eth3
> #chilli_lanif eth1
> #chilli_network 10.1.0.0
> #chilli_netmask 255.255.255.0
>
> address=/grasehotspot.lan/10.1.0.1
> address=/logout/1.0.0.0
> address=/logoff/1.0.0.0
>
> no-resolv
> strict-order
>
> expand-hosts
> domain=hotspot.lan
> server=192.168.40.1
> server=8.8.4.4
>
>
>
> cache deny all
> == Linux Distro and version ==
> No LSB modules are available.
> Distributor ID:    Ubuntu
> Description:    Ubuntu 11.10
> Release:    11.10
> Codename:    oneiric
> == Network Information ==
>
> = /etc/network/interfaces =
> # This file describes the network interfaces available on your system
> # and how to activate them. For more information, see interfaces(5).
>
> # The loopback network interface
> auto lo
> iface lo inet loopback
>
> # The primary network interface
> auto eth3
> #iface eth3 inet dhcp
>
> = Network Manager =
> ./collect-support-info.sh: 57: nmcli: not found
> == Network Manager settings ==
> cat: /etc/NetworkManager/NetworkManager.conf: No such file or directory
> ls: cannot access /etc/dnsmasq.d/network-manager: No such file or directory
> cat: /etc/dnsmasq.d/network-manager: No such file or directory
> = Hard disk information =
> Filesystem            Size  Used Avail Use% Mounted on
> /dev/sda3             184G  104G   71G  60% /
> udev                  7.9G  4.0K  7.9G   1% /dev
> tmpfs                 3.2G  2.1M  3.2G   1% /run
> none                  5.0M     0  5.0M   0% /run/lock
> none                  7.9G     0  7.9G   0% /run/shm
> /dev/sda2              92M   50M   38M  57% /boot
> = Status of services =
> == CoovaChilli ==
> ./collect-support-info.sh: 57: systemctl: not found
> status: Unknown job: chilli
> ./collect-support-info.sh: 57: systemctl: not found
> Usage: /etc/init.d/freeradius start|stop|restart|force-reload|reload
> ./collect-support-info.sh: 57: systemctl: not found
> Apache2 is running (pid 1710).
> ./collect-support-info.sh: 57: systemctl: not found
> ulimit: 33: error setting limit (Operation not permitted)
> Usage: /etc/init.d/squid3 {start|stop|reload|force-reload|restart}
> ./collect-support-info.sh: 57: systemctl: not found
> mysql start/running, process 1034
> ./collect-support-info.sh: 57: systemctl: not found
> network-manager: unrecognized service
>
>
>
> ===============================================================================
>
>
> On Sunday, May 20, 2018 at 2:41:35 PM UTC+2, timwhite88 wrote:
>>
>> Hi Gianluca
>>
>> Could you please run the support collection tool (
>> https://grasehotspot.org/support/collecting-support-information/) to
>> provide us with more information.
>>
>> The reason I ask, is that there are automated scripts that clean up parts
>> of the hotspot. In particular, the usage stats are in monthly totals, so
>> take up very little space per user after 2-3 months. However, it may be
>> possible you are running an older version where those scripts didn't work
>> and so that database has kept growing.
>>
>> Having said that, the first place to look to free up space is the backups
>> directory. /var/backups/grase/database/
>> No current version cleans this up, and so you may have 5+ years of
>> backups filling up that directory. Feel free to delete as much out of that
>> as you want. I've created an issue (
>> https://github.com/GraseHotspot/grase-www-portal/issues/174) to ensure
>> that in the future we do cleanup that directory. Any suggestions on how
>> much people want retained there by default would be appreciated.
>>
>> Regards
>>
>> Tim
>>
>> On Fri, 18 May 2018 at 07:35, Gianluca Filippini <gi***.@gmail.com>
>> wrote:
>>
>>> hi,
>>> I've searched in the forum but I did no find a clear answer... sorry if
>>> this has been asked already:
>>>
>>> My grase box has been running for few years now and the hard disk is
>>> filling up with logs and huge databases.
>>>
>>> is there a list of commands to delete everything (cleanup database,
>>> delete logs, backups etc) that is older than 1 month (or 1y) ?
>>> I'm referring to anything that GRASE might keep for stats and internal
>>> logs.
>>>
>>>
>>> thanks
>>>
>>> --
>>> This mailing list is for the Grase Hotspot Project
>>> http://grasehotspot.org
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "Grase Hotspot" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to gr***.@grasehotspot.org.
>>> To post to this group, send email to gr***.@grasehotspot.org.
>>> Visit this group at
>>> https://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>>> To view this discussion on the web visit
>>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/72c142d4-1ab3-4729-be6b-53b60ff90354%40grasehotspot.org
>>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/72c142d4-1ab3-4729-be6b-53b60ff90354%40grasehotspot.org?utm_medium=email&utm_source=footer>
>>> .
>>>
>> --
> This mailing list is for the Grase Hotspot Project http://grasehotspot.org
> ---
> You received this message because you are subscribed to the Google Groups
> "Grase Hotspot" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to gr***e@grasehotspot.org.
> To post to this group, send email to gr***t@grasehotspot.org.
> Visit this group at
> https://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
> To view this discussion on the web visit
> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/1b4b886b-8541-4086-8aa4-01087eae1c98%40grasehotspot.org
> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/1b4b886b-8541-4086-8aa4-01087eae1c98%40grasehotspot.org?utm_medium=email&utm_source=footer>
> .
>

Thread