2015-12-07 - Re: [GRASE-Hotspot] Large backups (Was Re: something odd happened - unable to login, after restart error 500)

Header Data

From: Mohammed Baqir Vakil <mb***6@gmail.com>
Message Hash: 8f182f14a338d57faf7633a942271b0a1972cf7abc500ca2e6f048a51adfb148
Message ID: <CAD_FyHbyTt7vO-md_ORCAMMioyPEqG2PRoio7ioY=ZBe19ZN2Q@mail.gmail.com>
Reply To: <CAD_FyHZBsN20PVie8fm54fZ9g9UTC=NHqSKVSVgriRS5EzEsLA@mail.gmail.com>
UTC Datetime: 2015-12-07 03:53:14 UTC
Raw Date: Mon, 07 Dec 2015 14:53:14 +0400

Raw message 

Hi Tim,

Updated the server and Grase (with the GPG fix notified in February this
year) too... must have been out of date for over a year 😅

Commands and output after update:

123@abc:~$ apt-cache policy grase-\
> lsb_release -a
N: Unable to locate package grase-lsb_release
123@abc:~$ uname -a
Linux avenetshare 3.2.0-94-generic-pae #134-Ubuntu SMP Fri Nov 6
18:45:23 UTC 2015 i686 i686 i386 GNU/Linux
123@abc:~$ cat /etc/grase/radmin.conf |grep -v password
sql_type: mysql
sql_server: localhost
sql_username: radmin
sql_radmindatabase: radmin
sql_command: /usr/bin/mysql


Thanks again!


Regards,

MB


On 7 December 2015 at 14:28, Mohammed Baqir Vakil <mb***6@gmail.com>
wrote:

> Hi Tim,
>
> Table truncated and space freed up, thanks!
>
> Commands and output:
>
> 123@abc:~$ apt-cache policy grase-\
> > lsb_release -a
> N: Unable to locate package grase-lsb_release
> 123@abc:~$ uname -a
> Linux avenetshare 3.2.0-94-generic-pae #134-Ubuntu SMP Fri Nov 6 18:45:23 UTC 2015 i686 i686 i386 GNU/Linux
> 123@abc:~$ cat /etc/grase/radmin.conf |grep -v password
> sql_type: mysql
> sql_server: localhost
> sql_username: radmin
> sql_radmindatabase: radmin
> sql_command: /usr/bin/mysql
>
>
> Regards,
>
> MB
>
>
> Mohammed Baqir Vakil
> +971509467360
> mb***6@gmail.com
>
> --
>
> I asked for strength...
> And Allah gave me difficulties to make me strong.
>
> I asked for wisdom...
> And Allah gave me problems to solve.
>
> I asked for prosperity...
> And Allah gave me brain and brawn to work.
>
> I asked for love...
> And Allah gave me troubled people to help.
>
> I asked for favours...
> And Allah gave me opportunities.
>
> I received nothing I wanted...
> I received everything I needed...
> My prayers have been answered...
>
> May Allah Bless you too.
>
> On 4 December 2015 at 15:27, Timothy White <ti***8@gmail.com> wrote:
>
>> Hi Mohammed
>>
>> Something is really broken with your install. The radmin database is
>> empty, completely empty. It's the database that stores the network
>> settings, portal customisations, admin users, etc.
>> On the other hand, your radius database looks ok, except it has the buggy
>> radpostauth table. This was fixed back in July last year, and pushed to the
>> stable release as a hotfix. The problem was that the radpostauth table was
>> growing continually and never being cleaned up. Your table is 8Gb now with
>> 73907022 rows!
>>
>> Can you please post the output of the following commands so I can try and
>> work out why you haven't gotten that hotfix, and why things look so crazy
>>
>> apt-cache policy grase-\
>> lsb_release -a
>> uname -a
>> cat /etc/grase/radmin.conf |grep -v password
>>
>> After that, you may wish to run the TRUNCATE command (via MySQL) on the
>> radpostauth table to fix it up and bring your backups to a normal size.
>>
>> Regards
>>
>> Tim
>>
>> On Fri, Dec 4, 2015 at 3:48 PM, Timothy White <ti***8@gmail.com>
>> wrote:
>>
>>> Hi Mohammed
>>>
>>> Would you mind sharing one of those large backups with me (privately as
>>> it's got sensitive data in it, Dropbox or Google Drive) so I can
>>> investigate. It's probably a broken cronjob that's caused by something in
>>> the database.
>>>
>>> Regards
>>>
>>> Tim
>>> On Dec 3, 2015 7:24 AM, "Mohammed Baqir Vakil" <mb***6@gmail.com>
>>> wrote:
>>>
>>>> Hi Timothy,
>>>>
>>>> That's right, 200MB+.
>>>>
>>>> The initial backups are quite small, maybe few hundred KB. Between 2014
>>>> and 2015 they've jumped in size. Just noticed this when my server wouldn't
>>>> respond on HTTP last week and did some digging around...
>>>> On 3 Dec 2015 1:07 a.m., "Timothy White" <ti***8@gmail.com> wrote:
>>>>
>>>>> Hi Mohammed
>>>>>
>>>>> Are you saying each daily backup is 200Mb? That sounds awfully large
>>>>> given that I have hotspots that have been running more than 3 years and the
>>>>> backup size is much less than that. If it is that large, I think the
>>>>> monthly archiving of traffic data may be broken.
>>>>>
>>>>> I am working on setting a limit for the backups, so we can have it
>>>>> auto clean old backups. Ideally this would come with a builtin function for
>>>>> rsyncing or uploading to cloud storage, the backups as they are generated.
>>>>> I currently having something like that setup on one hotspot, but it's just
>>>>> a hacked together script instead of integrated.
>>>>>
>>>>> Regards
>>>>>
>>>>> Tim
>>>>>
>>>>> On Thu, Dec 3, 2015 at 2:50 AM, Mohammed Baqir Vakil <
>>>>> mb***6@gmail.com> wrote:
>>>>>
>>>>>> In my case daily backups of Grase, roughly 200+MB, filled up my hard
>>>>>> drive...
>>>>>> On 2 Dec 2015 8:27 p.m., "Tomas213" <to***3@gmail.com> wrote:
>>>>>>
>>>>>>> My sys log was full some time ago, my disk was full too. I send a
>>>>>>> mail to Tim some days ago.
>>>>>>> If it happend to you too, maybe this is something we have to check.
>>>>>>>
>>>>>>> Thomas
>>>>>>>
>>>>>>> On Wed, Dec 2, 2015 at 5:29 PM, bartosz <ba***z@miklaszewski.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> ok fixed, syslog file had 55gb :) lol
>>>>>>>>
>>>>>>>> shocking
>>>>>>>>
>>>>>>>> i thought it was grase, panicked to quickly :D
>>>>>>>>
>>>>>>>> thx anyway :D
>>>>>>>>
>>>>>>>> all works after restart now :D
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Wednesday, 2 December 2015 14:11:06 UTC, bartosz wrote:
>>>>>>>>>
>>>>>>>>> hi,
>>>>>>>>>
>>>>>>>>> something bad happened to my hotspot, try to login to
>>>>>>>>> /grase/radmin/ but password was not accepted, i can login over ssh, so i
>>>>>>>>> thought ok i will reboot it, and after reboot now it shows server error 500
>>>>>>>>> when go to admin login page.... hotspot is not working right now at all...
>>>>>>>>>
>>>>>>>>> when i go just ip without /grase/radmin/ it shows apache welcome
>>>>>>>>> screen so it works... for some reason grase broke it self, and i didnt
>>>>>>>>> touch anything :|
>>>>>>>>>
>>>>>>>>> did anyone had this problem before?
>>>>>>>>>
>>>>>>>>> how did u fix it ?
>>>>>>>>>
>>>>>>>>> bad times :~|
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Bartosz
>>>>>>>>>
>>>>>>>> --
>>>>>>>> This mailing list is for the Grase Hotspot Project
>>>>>>>> http://grasehotspot.org
>>>>>>>> ---
>>>>>>>> You received this message because you are subscribed to the Google
>>>>>>>> Groups "Grase Hotspot" group.
>>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>>> send an email to gr***e@grasehotspot.org.
>>>>>>>> To post to this group, send email to gr***t@grasehotspot.org
>>>>>>>> .
>>>>>>>> Visit this group at
>>>>>>>> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>>>>>>>> To view this discussion on the web visit
>>>>>>>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/c94727d6-b4bf-4104-8620-58c95b8224e6%40grasehotspot.org
>>>>>>>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/c94727d6-b4bf-4104-8620-58c95b8224e6%40grasehotspot.org?utm_medium=email&utm_source=footer>
>>>>>>>> .
>>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> This mailing list is for the Grase Hotspot Project
>>>>>>> http://grasehotspot.org
>>>>>>> ---
>>>>>>> You received this message because you are subscribed to the Google
>>>>>>> Groups "Grase Hotspot" group.
>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>> send an email to gr***e@grasehotspot.org.
>>>>>>> To post to this group, send email to gr***t@grasehotspot.org.
>>>>>>> Visit this group at
>>>>>>> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>>>>>>> To view this discussion on the web visit
>>>>>>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAPz6xh7ZmxJ1hA-R%2BV-t-HWa-Zaf8XJvSpXsS%2BKo7jbr0TzPFw%40mail.gmail.com
>>>>>>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAPz6xh7ZmxJ1hA-R%2BV-t-HWa-Zaf8XJvSpXsS%2BKo7jbr0TzPFw%40mail.gmail.com?utm_medium=email&utm_source=footer>
>>>>>>> .
>>>>>>>
>>>>>> --
>>>>>> This mailing list is for the Grase Hotspot Project
>>>>>> http://grasehotspot.org
>>>>>> ---
>>>>>> You received this message because you are subscribed to the Google
>>>>>> Groups "Grase Hotspot" group.
>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>> send an email to gr***e@grasehotspot.org.
>>>>>> To post to this group, send email to gr***t@grasehotspot.org.
>>>>>> Visit this group at
>>>>>> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>>>>>> To view this discussion on the web visit
>>>>>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAD_FyHY2ERMBC%2BKLGw%2BNANW%2BW_67y%2BU4mnh6JzJVLThyin4hYw%40mail.gmail.com
>>>>>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAD_FyHY2ERMBC%2BKLGw%2BNANW%2BW_67y%2BU4mnh6JzJVLThyin4hYw%40mail.gmail.com?utm_medium=email&utm_source=footer>
>>>>>> .
>>>>>>
>>>>>
>>>>> --
>>>>> This mailing list is for the Grase Hotspot Project
>>>>> http://grasehotspot.org
>>>>> ---
>>>>> You received this message because you are subscribed to the Google
>>>>> Groups "Grase Hotspot" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>>> an email to gr***e@grasehotspot.org.
>>>>> To post to this group, send email to gr***t@grasehotspot.org.
>>>>> Visit this group at
>>>>> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>>>>> To view this discussion on the web visit
>>>>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAESLx0LVEo3Jv%3Dsh%3Dt9CBAELah2yJXtTNytFGE%3Dvc2mpe7vXtA%40mail.gmail.com
>>>>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAESLx0LVEo3Jv%3Dsh%3Dt9CBAELah2yJXtTNytFGE%3Dvc2mpe7vXtA%40mail.gmail.com?utm_medium=email&utm_source=footer>
>>>>> .
>>>>>
>>>> --
>>>> This mailing list is for the Grase Hotspot Project
>>>> http://grasehotspot.org
>>>> ---
>>>> You received this message because you are subscribed to the Google
>>>> Groups "Grase Hotspot" group.
>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>> an email to gr***e@grasehotspot.org.
>>>> To post to this group, send email to gr***t@grasehotspot.org.
>>>> Visit this group at
>>>> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>>>> To view this discussion on the web visit
>>>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAD_FyHb0b09ZBi0g0bgsHNG%2BasggQG0G2dSme8Di_%2BWh70jdoA%40mail.gmail.com
>>>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAD_FyHb0b09ZBi0g0bgsHNG%2BasggQG0G2dSme8Di_%2BWh70jdoA%40mail.gmail.com?utm_medium=email&utm_source=footer>
>>>> .
>>>>
>>>
>> --
>> This mailing list is for the Grase Hotspot Project
>> http://grasehotspot.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "Grase Hotspot" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to gr***e@grasehotspot.org.
>> To post to this group, send email to gr***t@grasehotspot.org.
>> Visit this group at
>> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>> To view this discussion on the web visit
>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAESLx0LxD_uZy9xuO%3DcoN-wx8nPTipXeqROeX9Z2S08na7UGCQ%40mail.gmail.com
>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAESLx0LxD_uZy9xuO%3DcoN-wx8nPTipXeqROeX9Z2S08na7UGCQ%40mail.gmail.com?utm_medium=email&utm_source=footer>
>> .
>>
>
>

Thread