2015-12-07 - Re: [GRASE-Hotspot] Large backups (Was Re: something odd happened - unable to login, after restart error 500)

Header Data

From: Timothy White <ti***8@gmail.com>
Message Hash: b1f00377fbaf73ee54b105fb74b0c2b9f492a8692fb5a087f31713afed119155
Message ID: <CAESLx0+DAk-=ODaGfc8eOTd=vPMPD+rtCbwgXZLL1GBg9ZHPUg@mail.gmail.com>
Reply To: <CAD_FyHbyTt7vO-md_ORCAMMioyPEqG2PRoio7ioY=ZBe19ZN2Q@mail.gmail.com>
UTC Datetime: 2015-12-07 04:47:02 UTC
Raw Date: Mon, 07 Dec 2015 21:47:02 +1000

Raw message 

Glad to hear

Unfortunately the apt-cache policy command didn't copy and paste properly,
so the data I was looking for isn't there. Sounds like the GPG issue was
your problem though, causing you to be out of date.

Regards

Tim


On Mon, Dec 7, 2015 at 8:53 PM, Mohammed Baqir Vakil <mb***6@gmail.com>
wrote:

> Hi Tim,
>
> Updated the server and Grase (with the GPG fix notified in February this
> year) too... must have been out of date for over a year 😅
>
> Commands and output after update:
>
> 123@abc:~$ apt-cache policy grase-\
> > lsb_release -a
> N: Unable to locate package grase-lsb_release
> 123@abc:~$ uname -a
> Linux avenetshare 3.2.0-94-generic-pae #134-Ubuntu SMP Fri Nov 6 18:45:23 UTC 2015 i686 i686 i386 GNU/Linux
> 123@abc:~$ cat /etc/grase/radmin.conf |grep -v password
> sql_type: mysql
> sql_server: localhost
> sql_username: radmin
> sql_radmindatabase: radmin
> sql_command: /usr/bin/mysql
>
>
> Thanks again!
>
>
> Regards,
>
> MB
>
>
> On 7 December 2015 at 14:28, Mohammed Baqir Vakil <mb***6@gmail.com>
> wrote:
>
>> Hi Tim,
>>
>> Table truncated and space freed up, thanks!
>>
>> Commands and output:
>>
>> 123@abc:~$ apt-cache policy grase-\
>> > lsb_release -a
>> N: Unable to locate package grase-lsb_release
>> 123@abc:~$ uname -a
>> Linux avenetshare 3.2.0-94-generic-pae #134-Ubuntu SMP Fri Nov 6 18:45:23 UTC 2015 i686 i686 i386 GNU/Linux
>> 123@abc:~$ cat /etc/grase/radmin.conf |grep -v password
>> sql_type: mysql
>> sql_server: localhost
>> sql_username: radmin
>> sql_radmindatabase: radmin
>> sql_command: /usr/bin/mysql
>>
>>
>> Regards,
>>
>> MB
>>
>>
>> Mohammed Baqir Vakil
>> +971509467360
>> mb***6@gmail.com
>>
>> --
>>
>> I asked for strength...
>> And Allah gave me difficulties to make me strong.
>>
>> I asked for wisdom...
>> And Allah gave me problems to solve.
>>
>> I asked for prosperity...
>> And Allah gave me brain and brawn to work.
>>
>> I asked for love...
>> And Allah gave me troubled people to help.
>>
>> I asked for favours...
>> And Allah gave me opportunities.
>>
>> I received nothing I wanted...
>> I received everything I needed...
>> My prayers have been answered...
>>
>> May Allah Bless you too.
>>
>> On 4 December 2015 at 15:27, Timothy White <ti***8@gmail.com> wrote:
>>
>>> Hi Mohammed
>>>
>>> Something is really broken with your install. The radmin database is
>>> empty, completely empty. It's the database that stores the network
>>> settings, portal customisations, admin users, etc.
>>> On the other hand, your radius database looks ok, except it has the
>>> buggy radpostauth table. This was fixed back in July last year, and pushed
>>> to the stable release as a hotfix. The problem was that the radpostauth
>>> table was growing continually and never being cleaned up. Your table is 8Gb
>>> now with 73907022 rows!
>>>
>>> Can you please post the output of the following commands so I can try
>>> and work out why you haven't gotten that hotfix, and why things look so
>>> crazy
>>>
>>> apt-cache policy grase-\
>>> lsb_release -a
>>> uname -a
>>> cat /etc/grase/radmin.conf |grep -v password
>>>
>>> After that, you may wish to run the TRUNCATE command (via MySQL) on the
>>> radpostauth table to fix it up and bring your backups to a normal size.
>>>
>>> Regards
>>>
>>> Tim
>>>
>>> On Fri, Dec 4, 2015 at 3:48 PM, Timothy White <ti***8@gmail.com>
>>> wrote:
>>>
>>>> Hi Mohammed
>>>>
>>>> Would you mind sharing one of those large backups with me (privately as
>>>> it's got sensitive data in it, Dropbox or Google Drive) so I can
>>>> investigate. It's probably a broken cronjob that's caused by something in
>>>> the database.
>>>>
>>>> Regards
>>>>
>>>> Tim
>>>> On Dec 3, 2015 7:24 AM, "Mohammed Baqir Vakil" <mb***6@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi Timothy,
>>>>>
>>>>> That's right, 200MB+.
>>>>>
>>>>> The initial backups are quite small, maybe few hundred KB. Between
>>>>> 2014 and 2015 they've jumped in size. Just noticed this when my server
>>>>> wouldn't respond on HTTP last week and did some digging around...
>>>>> On 3 Dec 2015 1:07 a.m., "Timothy White" <ti***8@gmail.com> wrote:
>>>>>
>>>>>> Hi Mohammed
>>>>>>
>>>>>> Are you saying each daily backup is 200Mb? That sounds awfully large
>>>>>> given that I have hotspots that have been running more than 3 years and the
>>>>>> backup size is much less than that. If it is that large, I think the
>>>>>> monthly archiving of traffic data may be broken.
>>>>>>
>>>>>> I am working on setting a limit for the backups, so we can have it
>>>>>> auto clean old backups. Ideally this would come with a builtin function for
>>>>>> rsyncing or uploading to cloud storage, the backups as they are generated.
>>>>>> I currently having something like that setup on one hotspot, but it's just
>>>>>> a hacked together script instead of integrated.
>>>>>>
>>>>>> Regards
>>>>>>
>>>>>> Tim
>>>>>>
>>>>>> On Thu, Dec 3, 2015 at 2:50 AM, Mohammed Baqir Vakil <
>>>>>> mb***6@gmail.com> wrote:
>>>>>>
>>>>>>> In my case daily backups of Grase, roughly 200+MB, filled up my hard
>>>>>>> drive...
>>>>>>> On 2 Dec 2015 8:27 p.m., "Tomas213" <to***3@gmail.com> wrote:
>>>>>>>
>>>>>>>> My sys log was full some time ago, my disk was full too. I send a
>>>>>>>> mail to Tim some days ago.
>>>>>>>> If it happend to you too, maybe this is something we have to check.
>>>>>>>>
>>>>>>>> Thomas
>>>>>>>>
>>>>>>>> On Wed, Dec 2, 2015 at 5:29 PM, bartosz <ba***z@miklaszewski.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> ok fixed, syslog file had 55gb :) lol
>>>>>>>>>
>>>>>>>>> shocking
>>>>>>>>>
>>>>>>>>> i thought it was grase, panicked to quickly :D
>>>>>>>>>
>>>>>>>>> thx anyway :D
>>>>>>>>>
>>>>>>>>> all works after restart now :D
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Wednesday, 2 December 2015 14:11:06 UTC, bartosz wrote:
>>>>>>>>>>
>>>>>>>>>> hi,
>>>>>>>>>>
>>>>>>>>>> something bad happened to my hotspot, try to login to
>>>>>>>>>> /grase/radmin/ but password was not accepted, i can login over ssh, so i
>>>>>>>>>> thought ok i will reboot it, and after reboot now it shows server error 500
>>>>>>>>>> when go to admin login page.... hotspot is not working right now at all...
>>>>>>>>>>
>>>>>>>>>> when i go just ip without /grase/radmin/ it shows apache welcome
>>>>>>>>>> screen so it works... for some reason grase broke it self, and i didnt
>>>>>>>>>> touch anything :|
>>>>>>>>>>
>>>>>>>>>> did anyone had this problem before?
>>>>>>>>>>
>>>>>>>>>> how did u fix it ?
>>>>>>>>>>
>>>>>>>>>> bad times :~|
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Bartosz
>>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> This mailing list is for the Grase Hotspot Project
>>>>>>>>> http://grasehotspot.org
>>>>>>>>> ---
>>>>>>>>> You received this message because you are subscribed to the Google
>>>>>>>>> Groups "Grase Hotspot" group.
>>>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>>>> send an email to gr***e@grasehotspot.org.
>>>>>>>>> To post to this group, send email to
>>>>>>>>> gr***t@grasehotspot.org.
>>>>>>>>> Visit this group at
>>>>>>>>> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>>>>>>>>> To view this discussion on the web visit
>>>>>>>>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/c94727d6-b4bf-4104-8620-58c95b8224e6%40grasehotspot.org
>>>>>>>>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/c94727d6-b4bf-4104-8620-58c95b8224e6%40grasehotspot.org?utm_medium=email&utm_source=footer>
>>>>>>>>> .
>>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> This mailing list is for the Grase Hotspot Project
>>>>>>>> http://grasehotspot.org
>>>>>>>> ---
>>>>>>>> You received this message because you are subscribed to the Google
>>>>>>>> Groups "Grase Hotspot" group.
>>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>>> send an email to gr***e@grasehotspot.org.
>>>>>>>> To post to this group, send email to gr***t@grasehotspot.org
>>>>>>>> .
>>>>>>>> Visit this group at
>>>>>>>> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>>>>>>>> To view this discussion on the web visit
>>>>>>>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAPz6xh7ZmxJ1hA-R%2BV-t-HWa-Zaf8XJvSpXsS%2BKo7jbr0TzPFw%40mail.gmail.com
>>>>>>>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAPz6xh7ZmxJ1hA-R%2BV-t-HWa-Zaf8XJvSpXsS%2BKo7jbr0TzPFw%40mail.gmail.com?utm_medium=email&utm_source=footer>
>>>>>>>> .
>>>>>>>>
>>>>>>> --
>>>>>>> This mailing list is for the Grase Hotspot Project
>>>>>>> http://grasehotspot.org
>>>>>>> ---
>>>>>>> You received this message because you are subscribed to the Google
>>>>>>> Groups "Grase Hotspot" group.
>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>> send an email to gr***e@grasehotspot.org.
>>>>>>> To post to this group, send email to gr***t@grasehotspot.org.
>>>>>>> Visit this group at
>>>>>>> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>>>>>>> To view this discussion on the web visit
>>>>>>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAD_FyHY2ERMBC%2BKLGw%2BNANW%2BW_67y%2BU4mnh6JzJVLThyin4hYw%40mail.gmail.com
>>>>>>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAD_FyHY2ERMBC%2BKLGw%2BNANW%2BW_67y%2BU4mnh6JzJVLThyin4hYw%40mail.gmail.com?utm_medium=email&utm_source=footer>
>>>>>>> .
>>>>>>>
>>>>>>
>>>>>> --
>>>>>> This mailing list is for the Grase Hotspot Project
>>>>>> http://grasehotspot.org
>>>>>> ---
>>>>>> You received this message because you are subscribed to the Google
>>>>>> Groups "Grase Hotspot" group.
>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>> send an email to gr***e@grasehotspot.org.
>>>>>> To post to this group, send email to gr***t@grasehotspot.org.
>>>>>> Visit this group at
>>>>>> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>>>>>> To view this discussion on the web visit
>>>>>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAESLx0LVEo3Jv%3Dsh%3Dt9CBAELah2yJXtTNytFGE%3Dvc2mpe7vXtA%40mail.gmail.com
>>>>>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAESLx0LVEo3Jv%3Dsh%3Dt9CBAELah2yJXtTNytFGE%3Dvc2mpe7vXtA%40mail.gmail.com?utm_medium=email&utm_source=footer>
>>>>>> .
>>>>>>
>>>>> --
>>>>> This mailing list is for the Grase Hotspot Project
>>>>> http://grasehotspot.org
>>>>> ---
>>>>> You received this message because you are subscribed to the Google
>>>>> Groups "Grase Hotspot" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>>> an email to gr***e@grasehotspot.org.
>>>>> To post to this group, send email to gr***t@grasehotspot.org.
>>>>> Visit this group at
>>>>> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>>>>> To view this discussion on the web visit
>>>>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAD_FyHb0b09ZBi0g0bgsHNG%2BasggQG0G2dSme8Di_%2BWh70jdoA%40mail.gmail.com
>>>>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAD_FyHb0b09ZBi0g0bgsHNG%2BasggQG0G2dSme8Di_%2BWh70jdoA%40mail.gmail.com?utm_medium=email&utm_source=footer>
>>>>> .
>>>>>
>>>>
>>> --
>>> This mailing list is for the Grase Hotspot Project
>>> http://grasehotspot.org
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "Grase Hotspot" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to gr***e@grasehotspot.org.
>>> To post to this group, send email to gr***t@grasehotspot.org.
>>> Visit this group at
>>> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>>> To view this discussion on the web visit
>>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAESLx0LxD_uZy9xuO%3DcoN-wx8nPTipXeqROeX9Z2S08na7UGCQ%40mail.gmail.com
>>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAESLx0LxD_uZy9xuO%3DcoN-wx8nPTipXeqROeX9Z2S08na7UGCQ%40mail.gmail.com?utm_medium=email&utm_source=footer>
>>> .
>>>
>>
>>
> --
> This mailing list is for the Grase Hotspot Project http://grasehotspot.org
> ---
> You received this message because you are subscribed to the Google Groups
> "Grase Hotspot" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to gr***e@grasehotspot.org.
> To post to this group, send email to gr***t@grasehotspot.org.
> Visit this group at
> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
> To view this discussion on the web visit
> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAD_FyHbyTt7vO-md_ORCAMMioyPEqG2PRoio7ioY%3DZBe19ZN2Q%40mail.gmail.com
> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAD_FyHbyTt7vO-md_ORCAMMioyPEqG2PRoio7ioY%3DZBe19ZN2Q%40mail.gmail.com?utm_medium=email&utm_source=footer>
> .
>

Thread