>
> Hi Clemens,
I have added a readme to the repository with the latest updates.[1]
I have attempted to explain the code the best I could.
The code functions correctly in the macports-base for the 57 ports that I
tested.[2]
The speed improvements are decent as per me. In real I don’t know the
exp
Hi,
I have implemented the points that we discussed till now in macports-base.
You can find the updated macports-base in my forked repository.
https://github.com/MihirLuthra/macports-base
I also have made many modifications to library to optimise it for use in
base. I haven’t updated in the read
Hi Clemens,
The library seems to be working good now in the macports-base.
Although I wanted to know till what extent should I let the data be shared?
Like just among a single phase? or all the phases of a port installation
can share common trace mode data?
Sandbox gets set after every phase, so w
Hi Clemens,
Probably I solved some issues from before. One general reason I found was
that my file descriptor was getting closed by some process.
I handled that by checking in close.c that the fd getting closed is not
referencing my files. This has made some errors to vanish. Installation of
some
Hi,
I have made many improvements to existing code.[1]
As for the latest details, in test file [2], where I have created 4 threads
and inputted 18,228 strings as arguments, it took
0.44 seconds for both insert and search 18228 threads at the same time and
3.5 MB memory (which is 4 times less as p
Hi Clemens,
I have added the functionality of utilising the wasted memory in shared
memory and as per the tests that I made till now, it works fine and drops
memory usage to half. [1]
Although I haven’t updated readme to contain info about this new feature.
This is more of a highly separate module
On Mon, May 13, 2019 at 2:19 AM Clemens Lang wrote:
> Hi Mihir,
>
> In my experience, it will make it much simpler to review the entire code
> if you expand your repository with a README file which gives a (textual)
> rough overview of how the code works, possibly with a link to the paper
> you i
>
>
>
>
> From what I understand from the stackoverflow post you're right that
> cmxpchg16b will not give a consistent view of the 16 bytes of memory
> across multiple NUMA nodes. However, maybe two 4 byte values right next
> to each other would be sufficient for your use case and could then be
> c
Hi,
On Wed, May 01, 2019 at 11:57:14AM +0530, Mihir Luthra wrote:
> For making my implementation of shared memory data structure more
> space efficient, I was trying to implement a stack which stores
> offsets to unused locations in the shared memory file. But as stack is
> being shared it also ne
Hi Clemens,
For making my implementation of shared memory data structure more space
efficient, I was trying to implement a stack which stores offsets to unused
locations in the shared memory file. But as stack is being shared it also
needs to be edited in a lock free way. While editing stack I nee
Hi Clemens,
> What's your current progress? Do you have some code already?
>
I made a complete offset based ctrie implementation in which any process
can insert and search on basis of a shared memory. Kindly provide me with
your views on it :)
All main code is in [1].
The header file contains
Hi,
Sorry for the late response.
What's your current progress? Do you have some code already?
>
Currently I am done with a basic Ctrie implementation as suggested in the
arXiv paper that is capable of inserting and searching paths. The
implementation is still with pointers which I will convert s
Hi,
On Sun, Apr 21, 2019 at 11:01:09PM +0530, Mihir Luthra wrote:
> This is almost the same way as in the arXiv paper you shared with me.
> As we are dealing with paths, I saw implementing the above hash
> function would make the search faster as this happens quite a few
> times that files with sa
Hi,
Thanks for the tips. ^_^
This is almost the same way as in the arXiv paper you shared with me.
As we are dealing with paths, I saw implementing the above hash function
would make the search faster as this happens quite a few times that files
with same name have same path length from the root.
Hi Mihir,
On Tue, Apr 16, 2019 at 11:59:53PM +0530, Mihir Luthra wrote:
> Kindly provide your suggestions for this.
> In the path search Ctrie data structure, I categorised the paths with
> the hash function working like:
>
> If I input a path /test/files/abc.h for check
> Here we have open to ab
Hi Clemens,
Kindly provide your suggestions for this.
In the path search Ctrie data structure, I categorised the paths with the
hash function working like:
If I input a path /test/files/abc.h for check
Here we have open to abc.h, the hash function simply makes it “12:abc.h"
where 12 is the length
Hi,
On Fri, Apr 12, 2019 at 11:16:46PM +0530, Mihir Luthra wrote:
> I was constructing the trie data structure which has to be operated
> from the address space mapped by mmap(2). In place of “array of next
> nodes”, I am using “array of offsets”.
Sounds correct.
> the void * returned from calli
Hi,
I needed some advise regarding ctrie implementation.
I was constructing the trie data structure which has to be operated from
the address space mapped by mmap(2).
In place of “array of next nodes”, I am using “array of offsets”.
the void * returned from calling mmap(2), I would type cast it a
On Tue, Apr 9, 2019 at 1:59 AM Clemens Lang wrote:
> Hi,
>
> On Sun, Apr 07, 2019 at 01:03:12AM +0530, Mihir Luthra wrote:
> > > Can you pastebin a main.log of a build that fails like this?
> >
> > https://pastebin.com/FVdp4WTw
>
> The problematic lines are
>
> :debug:archivefetch failed verifica
Hi,
On Sun, Apr 07, 2019 at 01:03:12AM +0530, Mihir Luthra wrote:
> > Can you pastebin a main.log of a build that fails like this?
>
> https://pastebin.com/FVdp4WTw
The problematic lines are
:debug:archivefetch failed verification with key
/opt/local/share/macports/macports-pubkey.pem
:debug:a
> That's unfortunately not the same, since while you're swapping the
> second value, a different thread could swap the first for a different
> value again.
>
I get your point.
Generally what comes to the mind in such circumstances is blocking the
other thread some way like mostly by spin locks.
Bu
Hi,
On Sat, Apr 06, 2019 at 01:05:08AM +0530, Mihir Luthra wrote:
> > You have the right ideas to solve the problem. Do keep in mind
> > though that CAS will only work up to a word size or a double word
> > size at most, i.e. swapping more than 64 bit with CAS atomically is
> > probably not going
Hi,
I was trying to test the code by making changes but I am stuck with one
issue.
If I install from git and set it up I always receive this error message. [1]
1) I tried `make` on base code taken as it is from git without checking out
to latest version, it showed this error.
2) I tried `make` on
Hi Clemens,
I see you're getting the hang of the difficulties of the project now :)
>
That’s really encouraging for me to know that you think so ^_^
> You have the right ideas to solve the problem. Do keep in mind though
> that CAS will only work up to a word size or a double word size at most,
Hi Mihir,
On Thu, Apr 04, 2019 at 06:25:00PM +0530, Mihir Luthra wrote:
> I have made the memory expansion idea precise and filtered out bugs
> from the one I sent previously.
> Please check the pdf in the attachment.
I see you're getting the hang of the difficulties of the project now :)
You ha
Hi,
I have made the memory expansion idea precise and filtered out bugs from
the one I sent previously.
Please check the pdf in the attachment.
Regards,
Mihir
MemoryExpansion.pdf
Description: Adobe PDF document
Hi Clemens,
I had some points in mind about mapping more memory when we run out of
memory, which I wanted to discuss with you.
Also you are right, this project is not at all short. I realise now, many
conditions need to be taken care of while doing tasks.
Each process shared 2 types of memory. O
On Sun, Mar 31, 2019 at 10:06:12PM +0530, Mihir Luthra wrote:
> I need help understanding *static* *int* TracelibRunCmd(Tcl_Interp
> *in), it has blown my mind, I am totally new with these kevents.
>
> I have been trying to understand that from a while now. Till what I
> understand, the thread res
Hi Clemens,
I was wondering if the trace mode optimisation project would be sufficient
for entire summer?
Because maximum effort is about understanding the code which needs to be
done before gsoc starts.
After that maybe the shared memory concept can be achieved within a month.
Maybe testing that
Hi there,
@Mojca Miklavec As I told you before, I will be
documenting trace mode alongside with understanding it,
I have been working on that
https://docs.google.com/document/d/15cVbH6f6hBr9HryJEHUZEbRsToN1BAjY8My-oRstO9A/edit#heading=h.oby3p7ljhsu
Sorry I told you I will get it done by the en
Hi,
I need help understanding *static* *int* TracelibRunCmd(Tcl_Interp *in),
it has blown my mind, I am totally new with these kevents.
I have been trying to understand that from a while now.
Till what I understand, the thread responsible for creating server
eventually calls tracelib run
and then
Hi Mihir,
On Thu, Mar 28, 2019 at 12:07:20AM +0530, Mihir Luthra wrote:
> On Wed, Mar 27, 2019 at 10:22 PM Mojca Miklavec wrote:
> > What I miss a bit is some clear definition of deliverables, what
> > pieces of code would be suitable enough for merging them into base
> > and when.
> >
> > Backgr
Hi there,
I had a question.
Before the build, dependencies are checked.
Enabling trace mode hides incompatible versions of the current software
being installed or the versions installed by other package managers and
more such.
The injected darwintrace.dylib will replace file operations if needed t
On Wed, Mar 27, 2019 at 10:22 PM Mojca Miklavec wrote:
> Dear Mihir,
>
> On Wed, 27 Mar 2019 at 17:25, Mihir Luthra wrote:
> >
> > Hi,
> >
> > I have shared my draft application from the GSoC dashboard.
> > Please provide me with feedbacks. :)
>
> Please note again that I'm not familiar with the
Dear Mihir,
On Wed, 27 Mar 2019 at 17:25, Mihir Luthra wrote:
>
> Hi,
>
> I have shared my draft application from the GSoC dashboard.
> Please provide me with feedbacks. :)
Please note again that I'm not familiar with the contents at all, so
I'm providing just some general feedback.
What I miss
Hi,
I have shared my draft application from the GSoC dashboard.
Please provide me with feedbacks. :)
Also, should I share the link to document here as well?
Regards,
Mihir
Hi,
Thanks for the helpful response ^_^.
I have been through the code files of porttrace.tcl, tracelib &
darwintrace. I understood their high level working.
I will go through the function __darwintrace_get_filemap() to understand
more about compare & swap & will look for more lock free primitives
On Mon, 25 Mar 2019 at 01:28, Christopher Chavez wrote:
>
> Hi Mihir, I am a MacPorts user and port maintainer. I have a suggestion, but
> am not a member, so do not take my advice as canon.
>
> > On Mar 23, 2019, at 1:52 PM, Mihir Luthra wrote:
> >
> > I was thinking to add an 8th section which g
Hi,
On Sun, Mar 24, 2019 at 08:40:30PM +0530, Mihir Luthra wrote:
> I had a few questions regarding Darwin trace library.
>
> Darwintrace library being injected, most I/O operations get
> reimplemented. If a “single” process is working on files, it more or
> less should call most of these functio
Hi,
On Wed, Mar 20, 2019 at 09:06:11PM +0530, Mihir Luthra wrote:
> I am not a master in dealing with low-level system stuff, but as I
> have worked pretty much with unix shell scripting and C language, I
> can connect to points.
>
> I wanted a few tips from you regarding the project:
> 1) W
Thanks for the helpful information ^_^.
Wiki seems to be a the right place to put all this information and later
(if possible), maybe some quick links on the main website to these wiki
pages would be helpful.
For now I guess you are right, will put anything I document on wiki.
Regards,
Mihir
Hi Mihir, I am a MacPorts user and port maintainer. I have a suggestion, but am
not a member, so do not take my advice as canon.
> On Mar 23, 2019, at 1:52 PM, Mihir Luthra <1999mihir.lut...@gmail.com> wrote:
>
> I was thinking to add an 8th section which gives a small high level tour of
> the
Hi,
I had a few questions regarding Darwin trace library.
Darwintrace library being injected, most I/O operations get reimplemented.
If a “single” process is working on files, it more or less should call most
of these functions again and again.
Like that particular process may call open, rename,
Greetings Mihir,
I am responding to this message on the developer mailing list in case anyone
else has more insight than I.
> Basically, user may have installed packages or files in past which reside in
> certain locations.(e.g. /usr/local)
Although trace made may help identify problems with
44 matches
Mail list logo
