[Sugar-devel] GSoC Project: Migration of Activities wiki-pages to GitHub
Vipul Gupta
vipulgupta2048 at gmail.com
Fri May 18 03:18:18 EDT 2018
Hi, I reviewed the script that you sent. I have some suggestions and a
method I used when I was working on the project.
How about parsing the activity page in HTML format rather than calling it
through the MediaWiki API, then in JSON, then extracting WikiText, then
Markdown through pandoc.
It's very simple really, in the sidebar of activities you will find a link
in each activity called printable version (Using the wiki --> printable
version). Click it and here in this example, you will land on this page.
https://wiki.sugarlabs.org/index.php?title=Activities/Ruler&printable=yes
I think you might find the accuracy and speed of the page conversion to be
improved to a better extent (HTML --> Markdown). Also, the HTML page that
you will request will also have image links embedded in it. Find them and
download the images from there only. I might be wrong using this method,
but it worked for me. What do you think?
[image: Screenshot_2018-05-18_12-39-50.png]
On Mon, May 14, 2018 at 11:50 AM Vipul Gupta <vipulgupta2048 at gmail.com>
wrote:
> Cool, thanks!
>
> On Mon, May 14, 2018 at 11:47 AM Rudra Sadhu <rdrsadhu at gmail.com> wrote:
>
>> I didn't.
>>
>> This is how it works(roughly):
>> https://github.com/rdrsadhu/beta-migration-script/blob/master/migrate.ipynb
>> I haven't had the time to clean/fine-tune it.
>>
>> On Mon, May 14, 2018 at 11:38 AM, Vipul Gupta <vipulgupta2048 at gmail.com>
>> wrote:
>>
>>> Hi,
>>> Rudra, have you sent the script I mentioned in the previous mail for
>>> your migration process. I haven't received it yet. Please check.
>>>
>>> On Sat, May 12, 2018 at 4:00 AM Vipul Gupta <vipulgupta2048 at gmail.com>
>>> wrote:
>>>
>>>> Great, as discussed in the meeting on Friday it would be very helpful
>>>> if I get an idea of your migration process.
>>>> Hence if you could upload your script on GitHub or send it here. It
>>>> would be much appreciated. Thanks.
>>>>
>>>> Happy Contributing !!
>>>>
>>>> On Fri, May 11, 2018 at 8:07 PM Rudra Sadhu <rdrsadhu at gmail.com> wrote:
>>>>
>>>>> Hello!
>>>>>
>>>>> We are done with our second weekly meeting discussing the project.
>>>>> (this was a very short meeting)
>>>>> Please find the logs at
>>>>> http://meeting.sugarlabs.org/sugar-meeting/meetings/2018-05-11T14:09:25
>>>>>
>>>>> And we will be doing the next meeting on next Friday at the same time
>>>>> 1600 CET.
>>>>>
>>>>> thanks,
>>>>> Rudra Sadhu
>>>>>
>>>>> On Tue, May 8, 2018 at 2:43 PM, Rudra Sadhu <rdrsadhu at gmail.com>
>>>>> wrote:
>>>>>
>>>>>> I realise I've not explained the project as well as I could/should
>>>>>> have.
>>>>>> This blog post[1] is an attempt to better define the same.
>>>>>>
>>>>>> We can discuss more about this in the sugar-devel meeting today, if
>>>>>> required.
>>>>>>
>>>>>> Regards,
>>>>>> Rudra Sadhu
>>>>>>
>>>>>> [1] :
>>>>>> https://rdrsadhu.github.io/blog/gsoc2018/2018-05-08-project-details/
>>>>>>
>>>>>>
>>>>>> On Mon, May 7, 2018 at 4:10 AM, James Cameron <quozl at laptop.org>
>>>>>> wrote:
>>>>>>
>>>>>>> Yes, we do seem to be talking to ourselves.
>>>>>>>
>>>>>>> The goal remains, though the mentors in that meeting didn't mention
>>>>>>> it; give them some slack, they haven't been especially heavy
>>>>>>> contributors to Sugar Labs. Of the three mentors present, Divyanshu,
>>>>>>> Onuwa, and Ibiam, only Ibiam has been a recently active contributor,
>>>>>>> and not to the Wiki, Help activity or https://help.sugarlabs.org/
>>>>>>>
>>>>>>> Re: Hello World. It is a coding example, has no use otherwise, so it
>>>>>>> should not be in activities.sugarlabs.org; I've disabled it.
>>>>>>> Version
>>>>>>> will be incremented when a release is made. Repository has no
>>>>>>> release
>>>>>>> tags. We need an activity maintainer for it. A checklist for
>>>>>>> maintaining an activity is here;
>>>>>>>
>>>>>>>
>>>>>>> https://github.com/sugarlabs/sugar-docs/blob/master/src/contributing.md#checklist---maintainer
>>>>>>>
>>>>>>> Across the activity set, we have very few activity maintainers. This
>>>>>>> will change as the GSoC coding period begins; particularly as Yash
>>>>>>> and
>>>>>>> Rahul begin working.
>>>>>>>
>>>>>>> Back on topic; Rudra's project has a purpose; it is a subset of
>>>>>>> activity maintenance, but the coding is automation that will be used
>>>>>>> _once_. Possibly a brain-numbing exercise, akin to road construction
>>>>>>> during the Irish potato famine.
>>>>>>>
>>>>>>> I've been a reviewer for the pull requests so far; four of them just
>>>>>>> now. Mentors, Walter, Tony, and others could help by reviewing
>>>>>>> Rudra's pull requests as they are made rather than leaving it to me.
>>>>>>> ;-)
>>>>>>>
>>>>>>> @Rudra, my recommendation is to set an order of work; start with the
>>>>>>> demonstration set of activities (Fructose), because we keep these
>>>>>>> maintained well, then work on the activities that Tony has listed as
>>>>>>> working with Ubuntu 18.04 or Thomas has listed as working with Fedora
>>>>>>> 28.
>>>>>>>
>>>>>>> @Rudra, also think through the whole ecosystem from coding to user,
>>>>>>> and propose changes to your project in response to your reading of
>>>>>>> the current mailing list thread. We're not expecting you to be a
>>>>>>> compliant robot, but an imaginative student. Situation reminds me of
>>>>>>> something I saw in the student guide;
>>>>>>>
>>>>>>>
>>>>>>> https://google.github.io/gsocguides/student/finding-the-right-project.html
>>>>>>>
>>>>>>> "Don’t be that person: Cut and pasting an idea from the organization
>>>>>>> page and turning that in as your project’s description is a big no-no.
>>>>>>> You’ll be expected to research and submit your own ideas about how to
>>>>>>> accomplish the project your way, not just state the end result."
>>>>>>>
>>>>>>> On Sun, May 06, 2018 at 10:44:06AM +0800, Tony Anderson wrote:
>>>>>>> > Hi, Walter
>>>>>>> >
>>>>>>> > Sadly, I saw no comment in the meeting that suggests the project
>>>>>>> includes this
>>>>>>> > goal. As you know, a common outcome to GSOC projects is that they
>>>>>>> are not
>>>>>>> > completed in the available time. Perhaps the project could be more
>>>>>>> explicit as
>>>>>>> > an update to the help activity than as a migration of wiki pages
>>>>>>> to github.
>>>>>>> >
>>>>>>> > Tony
>>>>>>> >
>>>>>>> > On Sunday, 06 May, 2018 09:55 AM, Walter Bender wrote:
>>>>>>> >
>>>>>>> > On Sat, May 5, 2018 at 9:04 PM Tony Anderson <[1]
>>>>>>> tony at olenepal.org> wrote:
>>>>>>> >
>>>>>>> > SugarLabs is our site to communicate with our users and
>>>>>>> prospective
>>>>>>> > users. GitHub is our site to support SugarLabs
>>>>>>> development. In this
>>>>>>> > meeting it is pointed out that maintaining two versions of
>>>>>>> the
>>>>>>> > wikipages will be difficult (obvious, since we are unable
>>>>>>> to maintain
>>>>>>> > even one). The evil word 'deprecation' was used (I would
>>>>>>> have preferred
>>>>>>> > - improved). It is logical to maintain markdown pages
>>>>>>> describing the
>>>>>>> > technical design of an activity (such as Browse or Turtle
>>>>>>> Blocks).
>>>>>>> > However, we need documentation for users with screenshots
>>>>>>> showing the
>>>>>>> > intended method of use and providing challenges to show
>>>>>>> advanced
>>>>>>> > capabilities. ASLO needs more help to enable users to make
>>>>>>> informed
>>>>>>> > decisions on which activities to download and install.
>>>>>>> >
>>>>>>> > Our current direction seems to lead to us talking only to
>>>>>>> ourselves.
>>>>>>> >
>>>>>>> > Part of this effort is to update/expand/improve the Help
>>>>>>> Activity. It seems
>>>>>>> > that this would make the documentation more rather than less
>>>>>>> accessible,
>>>>>>> > especially for our users with limited internet access.
>>>>>>> >
>>>>>>> > regards.
>>>>>>> >
>>>>>>> > -walter
>>>>>>> >
>>>>>>> > Tony
>>>>>>> >
>>>>>>> > On Friday, 04 May, 2018 10:54 PM, divyanshu rawat wrote:
>>>>>>> >
>>>>>>> > *
>>>>>>> > Hi Everyone,
>>>>>>> >
>>>>>>> > We are done with our first meeting with Rudra Sadhu
>>>>>>> and he is doing
>>>>>>> > great.
>>>>>>> > Here are the logs of today's meeting: [2]http://
>>>>>>> >
>>>>>>> meeting.sugarlabs.org/sugar-meeting/meetings/2018-05-04T14:17:25.
>>>>>>> > Please share your opinions and suggestions.
>>>>>>> > And we will be doing the next meeting on next Friday
>>>>>>> at the same
>>>>>>> > time 1600 CET.
>>>>>>> >
>>>>>>> > Best
>>>>>>> > Divyanshu
>>>>>>> >
>>>>>>> >
>>>>>>> >
>>>>>>> > On Mon, Apr 30, 2018 at 10:40 PM, divyanshu rawat <[3]
>>>>>>> > divyanshu.r46956 at gmail.com> wrote:
>>>>>>> >
>>>>>>> > I will be there to attend.
>>>>>>> >
>>>>>>> > On Mon, 30 Apr 2018 at 10:38 PM, Onuwa Nnachi
>>>>>>> Isaac <[4]
>>>>>>> > matrix4u2002 at gmail.com> wrote:
>>>>>>> >
>>>>>>> > Sounds good.
>>>>>>> >
>>>>>>> > On Mon, Apr 30, 2018, 18:07 Rudra Sadhu <[5]
>>>>>>> > rdrsadhu at gmail.com> wrote:
>>>>>>> >
>>>>>>> > Lets start this Friday. 1600 CET.
>>>>>>> > > sure, I'll be present. All community
>>>>>>> members are
>>>>>>> > invited to join as well.
>>>>>>> >
>>>>>>> > Nice article by the way, I made some
>>>>>>> corrections
>>>>>>> > regarding some typos.
>>>>>>> > > thanks a lot! I've rectified them in the
>>>>>>> blog.
>>>>>>> >
>>>>>>> > regards,
>>>>>>> > Rudra Sadhu
>>>>>>> >
>>>>>>> > On Mon, Apr 30, 2018 at 2:51 PM, Onuwa
>>>>>>> Nnachi Isaac <
>>>>>>> > [6]matrix4u2002 at gmail.com> wrote:
>>>>>>> >
>>>>>>> > Greetings from Nigeria,
>>>>>>> >
>>>>>>> > Welcome to Sugar Labs.
>>>>>>> >
>>>>>>> > Lets start this Friday. 1600 CET.
>>>>>>> >
>>>>>>> > We'll use the #sugar IRC.
>>>>>>> >
>>>>>>> > Nice article by the way, I made some
>>>>>>> corrections
>>>>>>> > regarding some typos.
>>>>>>> >
>>>>>>> > [7]Link to the correction
>>>>>>> >
>>>>>>> > Warm Regards
>>>>>>> >
>>>>>>> >
>>>>>>> > Nnachi Isaac Onuwa
>>>>>>> > [8]about.me/iamonuwa
>>>>>>> > *
>>>>>>> >
>>>>>>> > On Sat, Apr 28, 2018 at 12:54 PM,
>>>>>>> Rudra Sadhu <[9]
>>>>>>> > rdrsadhu at gmail.com> wrote:
>>>>>>> >
>>>>>>> > Greetings!
>>>>>>> >
>>>>>>> > Thank You for the opportunity to
>>>>>>> work with
>>>>>>> > Sugar Labs under the banner of
>>>>>>> Google Summer of
>>>>>>> > Code this year.
>>>>>>> >
>>>>>>> > I recently published an
>>>>>>> introductory blog post
>>>>>>> > [1], describing my GSoC 2018
>>>>>>> journey.
>>>>>>> > Hope you'll love giving it a read.
>>>>>>> >
>>>>>>> > To my mentors (Divyanshu Rawat and
>>>>>>> Onuwa Nnachi
>>>>>>> > Isaac) :
>>>>>>> > Let me know your preferences to
>>>>>>> set up a
>>>>>>> > regular set of meeting times to
>>>>>>> discuss the
>>>>>>> > project.
>>>>>>> > I would prefer them to be on
>>>>>>> #sugar so that
>>>>>>> > other community members could
>>>>>>> possibly join.
>>>>>>> >
>>>>>>> > Looking forward to a great summer.
>>>>>>> :)
>>>>>>> >
>>>>>>> > Thanks,
>>>>>>> > Rudra Sadhu
>>>>>>> >
>>>>>>> > [1] [10]
>>>>>>> https://rdrsadhu.github.io/blog/
>>>>>>> > gsoc2018/
>>>>>>> >
>>>>>>> > --
>>>>>>> >
>>>>>>> > Divyanshu Rawat / Software Developer
>>>>>>> > [11]divyanshu.r46956 at gmail.com / +41 779807546 /
>>>>>>> +91 8003856439
>>>>>>> >
>>>>>>> >
>>>>>>> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
>>>>>>> >
>>>>>>> > GSOC Mentor 2018 at Sugalabs, GCI 2017 Mentor at
>>>>>>> Sugar Labs
>>>>>>> > Stanford Scholar Initiative, Harvard Innovation
>>>>>>> Labs,
>>>>>>> > UnternehmerTUM GmbH
>>>>>>> > [12]www.divyanshurawat.me
>>>>>>> >
>>>>>>> >
>>>>>>> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
>>>>>>> >
>>>>>>> >
>>>>>>> [13]Twitter [s] [14]LinkedIn [s] [15]Github _ [16]Stack
>>>>>>> > Overflow [s] [17]Behance [s]
>>>>>>> >
>>>>>>> > --
>>>>>>> >
>>>>>>> > Divyanshu Rawat / Software Developer
>>>>>>> > [18]divyanshu.r46956 at gmail.com / +41 779807546 / +91
>>>>>>> 8003856439
>>>>>>> >
>>>>>>> >
>>>>>>> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
>>>>>>> >
>>>>>>> > GSOC Mentor 2018 at Sugalabs, GCI 2017 Mentor at Sugar
>>>>>>> Labs
>>>>>>> > Stanford Scholar Initiative, Harvard Innovation Labs,
>>>>>>> > UnternehmerTUM GmbH
>>>>>>> > [19]www.divyanshurawat.me
>>>>>>> >
>>>>>>> >
>>>>>>> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
>>>>>>> >
>>>>>>> >
>>>>>>> [20]Twitter [s] [21]LinkedIn [s] [22]Github [s] [23]Stack Overflow
>>>>>>> > [s] [24]Behance _
>>>>>>> >
>>>>>>> >
>>>>>>> > _______________________________________________
>>>>>>> > Sugar-devel mailing list
>>>>>>> > [25]Sugar-devel at lists.sugarlabs.org
>>>>>>> > [26]http://lists.sugarlabs.org/listinfo/sugar-devel
>>>>>>> >
>>>>>>> > _______________________________________________
>>>>>>> > Sugar-devel mailing list
>>>>>>> > [27]Sugar-devel at lists.sugarlabs.org
>>>>>>> > [28]http://lists.sugarlabs.org/listinfo/sugar-devel
>>>>>>> >
>>>>>>> > --
>>>>>>> > Walter Bender
>>>>>>> > Sugar Labs
>>>>>>> > [29]http://www.sugarlabs.org
>>>>>>> >
>>>>>>> >
>>>>>>> >
>>>>>>> > _______________________________________________
>>>>>>> > Sugar-devel mailing list
>>>>>>> > [30]Sugar-devel at lists.sugarlabs.org
>>>>>>> > [31]http://lists.sugarlabs.org/listinfo/sugar-devel
>>>>>>> >
>>>>>>> > References:
>>>>>>> >
>>>>>>> > [1] mailto:tony at olenepal.org
>>>>>>> > [2]
>>>>>>> http://meeting.sugarlabs.org/sugar-meeting/meetings/2018-05-04T14:17:25
>>>>>>> > [3] mailto:divyanshu.r46956 at gmail.com
>>>>>>> > [4] mailto:matrix4u2002 at gmail.com
>>>>>>> > [5] mailto:rdrsadhu at gmail.com
>>>>>>> > [6] mailto:matrix4u2002 at gmail.com
>>>>>>> > [7]
>>>>>>> https://docs.google.com/document/d/14GpTc9JMuCZ6SIZ04Do9i_DAemGOcw8DIqjBUADRRzo/edit?usp=sharing
>>>>>>> > [8]
>>>>>>> https://about.me/iamonuwa?promo=email_sig&utm_source=product&utm_medium=email_sig&utm_campaign=edit_panel
>>>>>>> > [9] mailto:rdrsadhu at gmail.com
>>>>>>> > [10] https://rdrsadhu.github.io/blog/gsoc2018/
>>>>>>> > [11] mailto:divyanshu.r46956 at gmail.com
>>>>>>> > [12] http://www.divyanshurawat.me/
>>>>>>> > [13] https://htmlsig.com/t/000001DCV8RZ
>>>>>>> > [14] https://htmlsig.com/t/000001DKT8C6
>>>>>>> > [15] https://htmlsig.com/t/000001DH4GT2
>>>>>>> > [16] https://htmlsig.com/t/000001DEFKRT
>>>>>>> > [17] https://htmlsig.com/t/000001DKZ3AC
>>>>>>> > [18] mailto:divyanshu.r46956 at gmail.com
>>>>>>> > [19] http://www.divyanshurawat.me/
>>>>>>> > [20] https://htmlsig.com/t/000001DCV8RZ
>>>>>>> > [21] https://htmlsig.com/t/000001DKT8C6
>>>>>>> > [22] https://htmlsig.com/t/000001DH4GT2
>>>>>>> > [23] https://htmlsig.com/t/000001DEFKRT
>>>>>>> > [24] https://htmlsig.com/t/000001DKZ3AC
>>>>>>> > [25] mailto:Sugar-devel at lists.sugarlabs.org
>>>>>>> > [26] http://lists.sugarlabs.org/listinfo/sugar-devel
>>>>>>> > [27] mailto:Sugar-devel at lists.sugarlabs.org
>>>>>>> > [28] http://lists.sugarlabs.org/listinfo/sugar-devel
>>>>>>> > [29] http://www.sugarlabs.org/
>>>>>>> > [30] mailto:Sugar-devel at lists.sugarlabs.org
>>>>>>> > [31] http://lists.sugarlabs.org/listinfo/sugar-devel
>>>>>>>
>>>>>>> > _______________________________________________
>>>>>>> > Sugar-devel mailing list
>>>>>>> > Sugar-devel at lists.sugarlabs.org
>>>>>>> > http://lists.sugarlabs.org/listinfo/sugar-devel
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> James Cameron
>>>>>>> http://quozl.netrek.org/
>>>>>>> _______________________________________________
>>>>>>> Sugar-devel mailing list
>>>>>>> Sugar-devel at lists.sugarlabs.org
>>>>>>> http://lists.sugarlabs.org/listinfo/sugar-devel
>>>>>>>
>>>>>>
>>>>>>
>>>>> _______________________________________________
>>>>> Sugar-devel mailing list
>>>>> Sugar-devel at lists.sugarlabs.org
>>>>> http://lists.sugarlabs.org/listinfo/sugar-devel
>>>>>
>>>>
>>>>
>>>> --
>>>> Cordially,
>>>> Vipul Gupta
>>>> Mixster <https://mixstersite.wordpress.com/> | Github
>>>> <https://github.com/vipulgupta2048>
>>>>
>>>
>>>
>>> --
>>> Cordially,
>>> Vipul Gupta
>>> Mixster <https://mixstersite.wordpress.com/> | Github
>>> <https://github.com/vipulgupta2048>
>>>
>>
>>
>
> --
> Cordially,
> Vipul Gupta
> Mixster <https://mixstersite.wordpress.com/> | Github
> <https://github.com/vipulgupta2048>
>
--
Cordially,
Vipul Gupta
Mixster <https://mixstersite.wordpress.com/> | Github
<https://github.com/vipulgupta2048>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.sugarlabs.org/archive/sugar-devel/attachments/20180518/26ee0da1/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Screenshot_2018-05-18_12-39-50.png
Type: image/png
Size: 308623 bytes
Desc: not available
URL: <http://lists.sugarlabs.org/archive/sugar-devel/attachments/20180518/26ee0da1/attachment-0001.png>
More information about the Sugar-devel
mailing list