2015-12-04 - Re: [GRASE-Hotspot] Large backups (Was Re: something odd happened - unable to login, after restart error 500)

Header Data

From: Timothy White <ti***8@gmail.com>
Message Hash: 9fe5b93265313c762d9012590c5c12530af4bc37a22b7e703b99b278d8e73ae8
Message ID: <CAESLx0LxD_uZy9xuO=coN-wx8nPTipXeqROeX9Z2S08na7UGCQ@mail.gmail.com>
Reply To: N/A
UTC Datetime: 2015-12-04 04:27:29 UTC
Raw Date: Fri, 04 Dec 2015 21:27:29 +1000

Raw message 

Hi Mohammed

Something is really broken with your install. The radmin database is empty,
completely empty. It's the database that stores the network settings,
portal customisations, admin users, etc.
On the other hand, your radius database looks ok, except it has the buggy
radpostauth table. This was fixed back in July last year, and pushed to the
stable release as a hotfix. The problem was that the radpostauth table was
growing continually and never being cleaned up. Your table is 8Gb now with
73907022 rows!

Can you please post the output of the following commands so I can try and
work out why you haven't gotten that hotfix, and why things look so crazy

apt-cache policy grase-\
lsb_release -a
uname -a
cat /etc/grase/radmin.conf |grep -v password

After that, you may wish to run the TRUNCATE command (via MySQL) on the
radpostauth table to fix it up and bring your backups to a normal size.

Regards

Tim

On Fri, Dec 4, 2015 at 3:48 PM, Timothy White <ti***8@gmail.com> wrote:

> Hi Mohammed
>
> Would you mind sharing one of those large backups with me (privately as
> it's got sensitive data in it, Dropbox or Google Drive) so I can
> investigate. It's probably a broken cronjob that's caused by something in
> the database.
>
> Regards
>
> Tim
> On Dec 3, 2015 7:24 AM, "Mohammed Baqir Vakil" <mb***6@gmail.com>
> wrote:
>
>> Hi Timothy,
>>
>> That's right, 200MB+.
>>
>> The initial backups are quite small, maybe few hundred KB. Between 2014
>> and 2015 they've jumped in size. Just noticed this when my server wouldn't
>> respond on HTTP last week and did some digging around...
>> On 3 Dec 2015 1:07 a.m., "Timothy White" <ti***8@gmail.com> wrote:
>>
>>> Hi Mohammed
>>>
>>> Are you saying each daily backup is 200Mb? That sounds awfully large
>>> given that I have hotspots that have been running more than 3 years and the
>>> backup size is much less than that. If it is that large, I think the
>>> monthly archiving of traffic data may be broken.
>>>
>>> I am working on setting a limit for the backups, so we can have it auto
>>> clean old backups. Ideally this would come with a builtin function for
>>> rsyncing or uploading to cloud storage, the backups as they are generated.
>>> I currently having something like that setup on one hotspot, but it's just
>>> a hacked together script instead of integrated.
>>>
>>> Regards
>>>
>>> Tim
>>>
>>> On Thu, Dec 3, 2015 at 2:50 AM, Mohammed Baqir Vakil <
>>> mb***6@gmail.com> wrote:
>>>
>>>> In my case daily backups of Grase, roughly 200+MB, filled up my hard
>>>> drive...
>>>> On 2 Dec 2015 8:27 p.m., "Tomas213" <to***3@gmail.com> wrote:
>>>>
>>>>> My sys log was full some time ago, my disk was full too. I send a mail
>>>>> to Tim some days ago.
>>>>> If it happend to you too, maybe this is something we have to check.
>>>>>
>>>>> Thomas
>>>>>
>>>>> On Wed, Dec 2, 2015 at 5:29 PM, bartosz <ba***z@miklaszewski.com>
>>>>> wrote:
>>>>>
>>>>>> ok fixed, syslog file had 55gb :) lol
>>>>>>
>>>>>> shocking
>>>>>>
>>>>>> i thought it was grase, panicked to quickly :D
>>>>>>
>>>>>> thx anyway :D
>>>>>>
>>>>>> all works after restart now :D
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Wednesday, 2 December 2015 14:11:06 UTC, bartosz wrote:
>>>>>>>
>>>>>>> hi,
>>>>>>>
>>>>>>> something bad happened to my hotspot, try to login to /grase/radmin/
>>>>>>> but password was not accepted, i can login over ssh, so i thought ok i will
>>>>>>> reboot it, and after reboot now it shows server error 500 when go to admin
>>>>>>> login page.... hotspot is not working right now at all...
>>>>>>>
>>>>>>> when i go just ip without /grase/radmin/ it shows apache welcome
>>>>>>> screen so it works... for some reason grase broke it self, and i didnt
>>>>>>> touch anything :|
>>>>>>>
>>>>>>> did anyone had this problem before?
>>>>>>>
>>>>>>> how did u fix it ?
>>>>>>>
>>>>>>> bad times :~|
>>>>>>>
>>>>>>>
>>>>>>> Bartosz
>>>>>>>
>>>>>> --
>>>>>> This mailing list is for the Grase Hotspot Project
>>>>>> http://grasehotspot.org
>>>>>> ---
>>>>>> You received this message because you are subscribed to the Google
>>>>>> Groups "Grase Hotspot" group.
>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>> send an email to gr***e@grasehotspot.org.
>>>>>> To post to this group, send email to gr***t@grasehotspot.org.
>>>>>> Visit this group at
>>>>>> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>>>>>> To view this discussion on the web visit
>>>>>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/c94727d6-b4bf-4104-8620-58c95b8224e6%40grasehotspot.org
>>>>>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/c94727d6-b4bf-4104-8620-58c95b8224e6%40grasehotspot.org?utm_medium=email&utm_source=footer>
>>>>>> .
>>>>>>
>>>>>
>>>>> --
>>>>> This mailing list is for the Grase Hotspot Project
>>>>> http://grasehotspot.org
>>>>> ---
>>>>> You received this message because you are subscribed to the Google
>>>>> Groups "Grase Hotspot" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>>> an email to gr***e@grasehotspot.org.
>>>>> To post to this group, send email to gr***t@grasehotspot.org.
>>>>> Visit this group at
>>>>> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>>>>> To view this discussion on the web visit
>>>>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAPz6xh7ZmxJ1hA-R%2BV-t-HWa-Zaf8XJvSpXsS%2BKo7jbr0TzPFw%40mail.gmail.com
>>>>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAPz6xh7ZmxJ1hA-R%2BV-t-HWa-Zaf8XJvSpXsS%2BKo7jbr0TzPFw%40mail.gmail.com?utm_medium=email&utm_source=footer>
>>>>> .
>>>>>
>>>> --
>>>> This mailing list is for the Grase Hotspot Project
>>>> http://grasehotspot.org
>>>> ---
>>>> You received this message because you are subscribed to the Google
>>>> Groups "Grase Hotspot" group.
>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>> an email to gr***e@grasehotspot.org.
>>>> To post to this group, send email to gr***t@grasehotspot.org.
>>>> Visit this group at
>>>> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>>>> To view this discussion on the web visit
>>>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAD_FyHY2ERMBC%2BKLGw%2BNANW%2BW_67y%2BU4mnh6JzJVLThyin4hYw%40mail.gmail.com
>>>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAD_FyHY2ERMBC%2BKLGw%2BNANW%2BW_67y%2BU4mnh6JzJVLThyin4hYw%40mail.gmail.com?utm_medium=email&utm_source=footer>
>>>> .
>>>>
>>>
>>> --
>>> This mailing list is for the Grase Hotspot Project
>>> http://grasehotspot.org
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "Grase Hotspot" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to gr***e@grasehotspot.org.
>>> To post to this group, send email to gr***t@grasehotspot.org.
>>> Visit this group at
>>> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>>> To view this discussion on the web visit
>>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAESLx0LVEo3Jv%3Dsh%3Dt9CBAELah2yJXtTNytFGE%3Dvc2mpe7vXtA%40mail.gmail.com
>>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAESLx0LVEo3Jv%3Dsh%3Dt9CBAELah2yJXtTNytFGE%3Dvc2mpe7vXtA%40mail.gmail.com?utm_medium=email&utm_source=footer>
>>> .
>>>
>> --
>> This mailing list is for the Grase Hotspot Project
>> http://grasehotspot.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "Grase Hotspot" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to gr***e@grasehotspot.org.
>> To post to this group, send email to gr***t@grasehotspot.org.
>> Visit this group at
>> http://groups.google.com/a/grasehotspot.org/group/grase-hotspot/.
>> To view this discussion on the web visit
>> https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAD_FyHb0b09ZBi0g0bgsHNG%2BasggQG0G2dSme8Di_%2BWh70jdoA%40mail.gmail.com
>> <https://groups.google.com/a/grasehotspot.org/d/msgid/grase-hotspot/CAD_FyHb0b09ZBi0g0bgsHNG%2BasggQG0G2dSme8Di_%2BWh70jdoA%40mail.gmail.com?utm_medium=email&utm_source=footer>
>> .
>>
>

Thread